Wednesday, April 27, 2016

Bulk URL download using xargs

If you are able to get bulk URLs for download fro a server, (which can be the case for some sequencing facilities) use this code, to pipe the list to xargs and then run wget sequentially on each of the input URLs:

cat file.url| xargs -I % sh -c 'echo %; wget %;'

No comments:

Post a Comment