There are times when you will end on a web page that looks like a folder and you can only find files being listed. This is because the webserver directory index file (index.html, default.asp and etc) is not present on the folder and the directory listings option in the webserver is turned on. One of the reason to offer directory listings is to provide a convenient way for the visitor to quickly browse the files in the folders and allow them to easily download the files to their computer. Sometimes directory listings are accidental due to careless webmasters who forgot to include a .htaccess or blank index file to prevent all the files from being listed.
To download the file, you can either click on it or right click and select “Save link as” in Firefox/Chrome or “Save target as” in Internet Explorer. However, if you need to download multiple or even all of the files from the directory including the subfolders automatically, you will need third party tools to help you achieve that. Here are 4 different methods that you can use download all files from a folder on a website.
1. Download Managers
If you are a frequent downloader, you probably already have a download manager program installed. It can be an add-on such as the popular FlashGot and DownThemAll! for Firefox or an independent software such as Internet Download Manager (IDM) and Free Download Manager (FDM). To download all of the files in a web directory with the Firefox download manager extensions, right click at an empty space on the page, and select DownThemAll! or FlashGot All from the context menu.
The download manager will then list all the files that it manages to find and lets you pick the ones that you want to download to your computer.
Do take note that FlashGot and DownThemAll! can only download all files on a directory but cannot download folders recursively. As for Internet Download Manager, select “Download all links with IDM” from the right click context menu, check the files that you want to download from the list and click OK.
Wget is a free and very powerful file downloader that comes with a lot of useful features including resume support, recursive download, FTP/HTTPS support, and etc. In “The Social Network” movie, Mark Zuckerberg is seen using the Wget tool to download all the student photos from his university to create Facemash. Wget is a command line tool which can be a bit difficult to use for some basic users.
Thankfully there are free front-end GUI’s for Wget such as VisualWget that makes it so much easier to use Wget by simply clicking on the check boxes rather than manually typing the command line arguments. Download VisualWget, extract and run VisualWget.exe. Click on the New icon to open a New Download window. Enter the URL that you want to download and select the location that you want to save the files to.
If you need to download multiple folders including subfolders, go to Advanced, click on Recursive Retrieval and tick on the first checkbox “–recursive“. Finally click OK to start downloading.
Although there are a few GUIs for Wget, we recommend VisualWget because it is free, portable, comes together with Wget and there is no need to download separately and manually unpacking it to the program’s folder or even configuring the path.
To download more than just the visible files or use FTP, try the methods on Page 2.