Tuesday, September 30, 2014

How to download multiple files from URL using wget

If you want to download multiple files from a URL using wget :

wget -e robots=off -r -l1 --no-parent -A.gz http://hapmap.ncbi.nlm.nih.gov/downloads/ld_data/latest/

This will download all gz archives from http://hapmap.ncbi.nlm.nih.gov/downloads/ld_data/latest/

1 comment:

  1. That is a good command to share. Tricky thing outside of linux OS is installing wget on Mac OSX. I use a package manager called homebrew for this purpose.
    Our cluster is red hat, wget is version 1.12 . It does not have a robots parameter. What version are you using?