Slashdot Mirror

What's to stop me from 'scraping' the info? What's to stop me from simply downloading the entire site with something like this? Slowly if needed to avoid arousing suspicion..

You might want to take a look at HTTrack: http://www.httrack.com/

so perhaps I can use my Mac to work on the drive

was the drive originally from a Mac?, even so Linux is the way to go as it has support for all the filesystem types in kernel and the distribution should also have filesystem tools like reiser.fsck. Is it from a linux distribution this hard drive?

No, it was a drive I got for the Linux PC at the same tyme. This PC is the only computer it's been installed in. The original drive that came installed in the PC was only 40GB however I had more than 500GB on the drive in an old PC I was replacing. So I got a new 750GB drive when I got the PC. I could have gotten a PC with a bigger drive but that cost more than getting a second drive.

Unfortunately I'll probably have a problem with the next part

That's as far as filesystem recovery goes. It depends on the way the crash happened

Luckily I think the PC didn't crash while I was using it, instead I did a fresh boot after it was off for a few hours. When I did it didn't boot-up right. Seeing as it was under an extended warranty I paid for when I bought the PC and the store was only a miles and I wasn't in a rush to do anything else I put the PC in my car and drove to the store.

After they ran diagnostics they told me the motherboard had to be replaced. Now I realize what I should have done was remove the drive before they did any work, perhaps swapped it with a another used drive. I've got a couple laying around. But stupid me, I thought the tech would do what I said I wanted done.

/lost+found/000753490/websave/funstuff/picturesofdogs

Some photos of a couple of cats but not of dogs. I do have hundreds of photos though. I took some good shots of wind surfers on a lake during summer and winter. Others were from trips, my garden, and the neighborhood. Still other photos I took for my classes in photography. Luckily I only have a film based 35mm camera and I still have my film, going back more than 10 years. I ordered photocds when I turned in the film for personal use, I turned in the film for my classes in the lab on campus. I now have a film scanner which scans at a higher resolution than the photo shops offer, so I think I'll scan all my film.

However as I said I've done a lot of research online and whenever I come across a webpage I want to keep I'll save it to disk. For websites that were only a few pages, when I used Linux or Windows, I used HTTrack to save them. There isn't a version of it for OS X though so now I manually save webpages., which brings up something that pisses me off about Firefox, FF doesn't save pages with a standard file name such as the page title nor does it write the url the page is saved from. As much as people gripe about IE at least it saves a page using the title and it includes the url. With FF every page I save I open the html file with an editor so I can paste in the url. There are supposed to be FF add-ons that do these for you but I read reviews for all of them I found and they all have problems.

Which is why you want to have all the right tools available from the get go and no resistance from the OS. It's crap doing this sort of thing but I totally empathise with you. Stick with the routine and you should be ok, just get ready for a lot of repetitive stuff.

Okay, I suppose I'll run the commands and software from Linux. Now I need to see how I can install a third hard disk drive in the PC or I'll have to put up with the slowness of USB.

Thanks.

Falcon

If like me you want to make a backup of your site but only had the free account sans FTP httrack may be useful.

I wonder if the put the option to make favorites available when offline back in IE? It's not in IE 7 anymore. It was actually kinda useful for traversing and downloading webpages to store offline for use while traveling. Though I must say HTTrack does a fine job of it.

If they had the world's most extensive blog, with hundreds of thousands of words scattered through thousands of posts, and six weeks isn't enough time to evacuate ...

Such a person needs to archive their entire website.

There is one such utility that comes to mind. It is called HTTrack and is freely available for a variety of platforms.

From the site:

HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.

It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.

Been using it for years and it works VERY well.

Don't have fink, but yep I have. I'm using iterm instead of Terminal. I'm not currently using Fink, but I have in the past.

On Windows and Linux I used HTTrack website copier to download some websites or pages and sections. Since there wasn't, isn't, a native Mac port of it I installed Fink and Fink Commander to download the X11 version. However I couldn't figure out how to get them to work.

Why not adapt some FOSS software? Because you want/need the copyright to "protect" you? Is it not better to cooperate with other photographers to develop the software - in that way you might not only get better software, but also get more time to photograph, which seemingly is the point of the whole software thing.

I have thought of that, I specifically thought about using software with one of the BSD type licenses.

I've contributed quite a lot of code to GPL'ed software, most of it "owned" by commercial vendors.

Oh I have thought about contributing to GPL'ed software. There's one program that I'll specifically thought of, HTTrack. I have frequently downloaded, ripped, websites for research and when I've used Linux I used HTTrack or WinTrack on Windows. Now I'm using OS X and though it runs in OS X it requires X11, so I'd like to port it the run natively on OS X.

Putting a price on everything is not necessarily the best solution. Don't you ever work together with your neighbours to fix the playground?

I don't know any neighbors, so no I haven't worked with any of them. I used to volunteer though. As a full tyme student in college even though I was majoring in Computer Engineering I volunteered frequently for the Student Affairs Coordinator, the stage dancing program, and theatre program. I even took a class in ASL, American Sign Language, so I could talk with hearing impairs students which eventually led to a job working for handicapped services.

You should also be aware that if you GPL the "old" versions you have, some other people will likely improve on your software and start using it. As your "newest" version is NOT GPL'ed, you cannot apply their patches. So, you will most likely end up with a competing, non-free version. If your program is any good, you will end up with the most expensive and likely worst of the two.

Which is why I'd rather use a BSD style license for any software I'd want to sale.

Fink is a package manger based on debian aptget. there's thousands of free packages there. and because the mac environment is so homogeneous they build seamlessly without surprises, many downloadable in binary form. works great from the command line or from the gui. Easy to keep up-to-date

I've brought up Fink, and MacPorts, previously and said how they can install a lot of the software that can be installed in Linux. I have Fink installed myself. However I only tried to download and install one program with it, HTTrack, but I was unable to download it. I checked the Fink website but didn't find any help, and going through the HTTrack forums didn't help either. Because I like to download and save a lot of webpages, and a few compleat websites, I'd like to get it working.

1. Openoffice (NeoOffice sucks and I don't want to use openoffice X on the mac and deal with strangeness. And so I'm reliant on MS Office

I have and use NeoOffice and there's no problem with it, not even with MS Office 2007 docs I downloaded from the web. Maybe you tried an older version if NeoOffice didn't work. Also MS Office runs on Macs, but not on Linux without WINE or CrossOver. Though I won't use it a trialware version came on my MBP.

2. I do some computations (code in fortran)

This I can see, a special app. Maybe XCode 2 or the new version 3 will work. I don't plan on trying Fortran on the Mac but I plan to tryout Free Pascal and want to learn Smalltalk.

4. I don't want to use Fink on mac I'd rather just use native apps on linux (I'm not a programmer, but I like to tinker)

I tried to use Fink to install HTTrack but for some reason it wouldn't download. Just as well though, I want to create an OS X native port install of use the X11 port.

So mostly it's not that you can't use Macs but that you want to use specific brand named apps that don't run on Macs instead of an app that does the same thing.

I'm not very fond of iWork. It looks too simple compared to OOo and Office.

I haven't and don't plan on trying iWork. Unless and until MS stops treating it's users like criminals I will avoid MS products if I can. As for OO.org I wouldn't use it either as it requires X11. While I've installed X11, the only reason was so I could install HTTrack, I'd prefer to run native apps. For this reason I installed Neo Office instead.

But then again, like I said, I'm hoping the new release improves Xcode alot.

A few days ago I got a dvd Apple mailed me with updated kits and tools.

Eclipse may not be your thing if you are ONLY developing for Mac because you don't have to worry about a cross platform IDE

I'm new at this so I don't think I'll be doing much development or programming 'til I learn more. However the first thing I want to do is program a native port of HTTrack website copier. I've used the Windows version as well as a linux version for kde and I like the gui interface, from what I could find though while the current version for Macs runs in X11 it still uses the command line. Once I have a native port running I would like to work on a suit of apps for photographers, one package with a photo editor, accounting software, bidding software, a database, and general software for running a business, as well as a means for photographers to create a website so that they could find a host and create an online portfolio and maybe a store. I want to use open source programs for each of these that already exists however I want to create a software bundle where everything can be installed at one tyme and then have it use an integrated interface. For instance within the editor call up a customer's contract then have the photos added to the database and create an entry into the account's billings. Since many photographers still use Macs and I want to work in photography myself and I use a Mac I'd make it native Mac, then later work on porting it to Linux and or Windows.

http://www.httrack.com/

Productivity:

Graphics:

Media:

Internet:

Survival Kit:

Development:

I would say the gentleman behind HT Track is an unsung hero. I sent him a bug report with pseudo-code as a guess to how to fix it. The very next day, he had sent me a thank-you email and had released a new version. I also found the Mozilla team to be very responsive to my suggestions here on Slashdot (one post turned into a new Mozilla feature -- pre-fetching). And the HTML-Kit team is very responsive to bug reports and patches too. I like all three teams at the geek level. Their products satisfy an important niche in Web development, they're responsive and accept code patches (even my poorly done offerings, with cleanup of course). I feel quite happy to call them unsung heroes of the OSS movement, and this is my second shot at singing their praises (see previous "unsung heroes of open source" article).

If you want, you can follow these steps to make your own mirror of suprnova.org:

Go to http://www.httrack.com/ to get the website copier (to make mirror of entire site)and install it.

Then using httrack that you just installed, make a mirror of www.bi-torrents.com and pass it to your buddy

[I have no affiliation to any of the sites mentioned above. I just read the /. discussion and saw that anyone could easily make their own mirror]

I've submitted a lot of bug reports and patches to various software projects -- but typically only the 1 or 2 fixes that I need to get it working for me. So I have a not-too-deep but very broad interaction with a lot of different GPL & BSD projects. In fact, I've even submitted patches to projects with closed-source (like faqts -- gave them patches to better rank members and score answers... but they never made any improvement using my code or anyone else's). In fact, the faqts site is par-for-the-course. Most projects don't seem to respond.

So I would nominate the gentleman behind HT Track. I sent him a bug report with pseudo-code as a guess to how to fix it. The very next day, he had sent me a thank-you email and had released a new version. I also found the Mozilla team to be very responsive to my suggestions here on Slashdot (one post turned into a new Mozilla feature -- pre-fetching). And the HTML-Kit team is very responsive to bug reports and patches too. I like all three teams at the geek level. They're responsive and accept code, even cleaning up my poorly done offerings. I feel quite happy to call them unsung heroes of the OSS movement, and I'd feel even happier if they were sung heroes.

Total size is 450MB, compressed down to 130MB using WinRAR 3.3.

View info and download the torrent here.

These are some of the free (speech or beer) software I'd install on a family, non-gaming machine:

• Web Browser: Mozilla or Mozilla Firebird
• E-mail: Mozilla (cross-platform), Mozilla Thunderbird (cross-platform), Evolution (Gnome), or KMail (KDE)
• Office Suite: OpenOffice.org
• Media Player: QuickTime (Windows), Zinf (cross-platform), RealPlayer (cross-platform), WinAmp (Windows), MPlayer (Windows), XMMS (Linux)
• Image Viewer: IrfanView (Windows)
• Instant Messaging: Gaim (cross-platform)
• Personal Information Management: Palm Desktop Software (great PIM suite even if you don't own a Palm)
• Other: Acrobat Reader (although I'm weary of their DRM), Java 2 Runtime Environment, Macromedia Flash and Shockwave players, Ad-Aware (spyware remover for Windows), ZoneAlarm, Sygate Personal Firewall (firewall, alternative to ZoneAlarm), Grisoft AVG Anti-Virus, FileZilla, WinRAR (not free, shareware with nag window), Ofoto desktop software (basic photo album and touch-ups, even if you don't use Ofoto's online services)

Some other software I'd install on my own desktop (dev), in decreasing order of importance:

• Cygwin, bascially all packages
• UltraEdit32 (45-day trial shareware)
• TightVNC
• Ghostscript and GSView
• Java 2 SDK
• Eclipse
• Borland JBuilder Personal
• ActiveState Perl, Python, Tcl/Tk (yes, even though they are in Cygwin), Jython
• GIMP
• POV-Ray
• At least one of Apache, Tomcat, or Plone (Zope)
• HTTrack (a website copier)

Everything, and then some.

httrack -D -c3 -O RevEng http://www.acm.uiuc.edu/sigmil/RevEng/

http://www.httrack.com/

I've racked up 10 gigs of random stuff using httrack. Just type in some portal and have it just pick up 100 gigs of anything.

a great example of french programming excellence is httrack - a powerful website copier / offline browser released under the GPL

it runs under both windows and linux (both an rpm and a deb exist), and includes both a GUI and a command line operation capability

http://www.httrack.com

Description from the Author:

HTTrack is a free (libre/open source) and easy-to-use offline browser utility.

It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.