Downloading a large number of files automatically?

Pigman II

I'm trying to save a large number of files that are contained with the subdirectories of a particular website. Problem is that whilst the files are small and freely available there is literally thousands of them them to save and this takes time (not to mention patience!) when you have to click and save every single one of them by hand.

So I was wonder if there was a program out there that you could tell to save EVERY SINGLE FILE past a particular part in a web URL

******************************************************
eg if you have:

www.takethis.com\directories\dir1\file1.etc
www.takethis.com\directories\dir1\file2.etc
|
|
|
www.takethis.com\directories\dir2\file1.etc
|
|
|
|
|
|
www.takethis.com\directories\dirN\fileN.etc

then save everything past the root address that is available for download (and if possible copy the directory structures onto my harddrive ).
******************************************************

So basically what I want is for everything in 'directories' and all it's subdirectories to be saved to my harddrive without me having to the 'legwork'.




Any suggestions gratefully recieved.

daveirl

This post has been deleted.

KdjaCL

Try and find those little files in one large file and download that.;)



kdjac

parasite

http://www.leechget.de/html/download.html

http://www.httrack.com/index.php

http://www.sparkleware.com/ -superbot

tman

copy the url, open getright, press ctrl+b... sorted.

use the ctrl key to select multiple files & the shift key to select multiple files between 2 points

TenLeftFingers

Teleport pro probably does the same job. I just paste in the address, tell it how many links deep you want to go and off you go. You can also tell it to ignore or filter certain file types. You can either create a browsable duplicate of the site on your computer, or just get the files.

jabberwock

Webreaper is like that. Give it an address and it pulls down everything as far in that you want onto your machine.

yellum

use the windows port of wget

use the command wget -rnp www.website.com/directory

Inspector Gadget

Do any of these packages support pulling URLs from JS/VB scripts?

I know it's something that's almost impossible to implement completely, but even if it looked for stuff like "src=" in scripts it would be handy for most rollovers, etc... I know Teleport Pro doesn't bother with any of this, but maybe, just maybe, one of the above does?

Gadget

SouperComputer

i dont know, but you could try netants, from www.netants.com

you can right click on a webpage and select "download all by netants"

Pigman II

Thanks everyone for your suggestions! I tried http://www.httrack.com/index.php and it did the trick for me.

parasite

what do i win ?