hey guys,
I used to have an app that would crawl a website automatically and save every file into a specific folder. you could filter by file type extensions (omg only DL teh naked lady JPEGS!), or just say "pull the whole thing down", and it would create a working offline copy of any website you aimed it at. you could also specify link depth, like "start on page X, and download anything less than 2 jumps away".. like if a site had an archive, you would hop to february, then to 'feb 10th' or whatever, but you would make sure the spider wouldn't follow a banner ad to some random site, then start DLing everything that that banner led to, etc.
i really don't remember the name of the app i used to have, but I've found a few that offer very similar functionality.
Jocsoft's JOC Web Spider works beautifully. it's absolutely perfect. fast, pulls down the whole site, puts it all in one clean folder. it's awesome. it costs 30$, though, and i'm looking for a freebie.
Website Ripper Copier does the job, and certainly looks much fancier, but it's slow as all hell, you end up with a folder full of 8000 other folders, and while i happened to come across a 'free' copy, i don't really like it. trying to find "the original index.htm" that you aimed the program at is a bit overwhelming, and why it takes 15 minutes to do the same thing JOC does in 47 seconds is a mystery.
in the end I may just end up buying the JOC one, but I'm throwing a bone out there and seeing if you guys have anything that fits the bill.
you're wondering why i want this, i can feel it. my wife is a really avid blogger, and she's basically documenting the whole "being pregnant with the first baby thing" pretty thoroughly. people not intimately involved with website backends have a hard time understanding that she may log in one day to find it all gone, and i'd like to keep this slice of our life preserved on a CD to look at later, along with our photos, etc. it's sappy. so sue me.
in the end, i don't really have an issue with spending the money, it's a good cause, but before i drop the money, i just want to make sure there isn't a better one out there that i should have known about beforehand.
cheers.
I used to have an app that would crawl a website automatically and save every file into a specific folder. you could filter by file type extensions (omg only DL teh naked lady JPEGS!), or just say "pull the whole thing down", and it would create a working offline copy of any website you aimed it at. you could also specify link depth, like "start on page X, and download anything less than 2 jumps away".. like if a site had an archive, you would hop to february, then to 'feb 10th' or whatever, but you would make sure the spider wouldn't follow a banner ad to some random site, then start DLing everything that that banner led to, etc.
i really don't remember the name of the app i used to have, but I've found a few that offer very similar functionality.
Jocsoft's JOC Web Spider works beautifully. it's absolutely perfect. fast, pulls down the whole site, puts it all in one clean folder. it's awesome. it costs 30$, though, and i'm looking for a freebie.
Website Ripper Copier does the job, and certainly looks much fancier, but it's slow as all hell, you end up with a folder full of 8000 other folders, and while i happened to come across a 'free' copy, i don't really like it. trying to find "the original index.htm" that you aimed the program at is a bit overwhelming, and why it takes 15 minutes to do the same thing JOC does in 47 seconds is a mystery.
in the end I may just end up buying the JOC one, but I'm throwing a bone out there and seeing if you guys have anything that fits the bill.
you're wondering why i want this, i can feel it. my wife is a really avid blogger, and she's basically documenting the whole "being pregnant with the first baby thing" pretty thoroughly. people not intimately involved with website backends have a hard time understanding that she may log in one day to find it all gone, and i'd like to keep this slice of our life preserved on a CD to look at later, along with our photos, etc. it's sappy. so sue me.
in the end, i don't really have an issue with spending the money, it's a good cause, but before i drop the money, i just want to make sure there isn't a better one out there that i should have known about beforehand.
cheers.
