command :
wget -i
Buat file untuk list data download
~$ vi list-download.txt
~$ cat list-download.txt
data-download1.pdf
data-download2.pdf
data-download3.pdf
~$ crontab -e
set time untuk waktu mulai download file, misalkan kita ingin jalankan ketika tengah malam jam 3.00 am
00 03 * * * * wget -i /directory/path/list-download.txt > download.logkemudian save crontab.
Proccess :
--2014-10-08 03:00:00-- https://domain.com/data-download1.pdf
Connecting to domain.com (domain.com)|54.231.244.0|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5821575 (5,6M) [pdf]
Saving to: ‘data-download1.pdf’
100%[=====================================================================================================>] 5.821.575 77,4KB/s in 72s
2014-10-08 03:15:00 (78,7 KB/s) - ‘data-download1.pdf’ saved [5821575/5821575]
--2014-10-08 03:15:01-- https://domain.com/data-download2.pdf
Reusing existing connection to domain.com.
HTTP request sent, awaiting response... 200 OK
Length: 6531095 (6,2M) [pdf]
Saving to: ‘data-download2.pdf’
100%[=====================================================================================================>] 6.531.095 101KB/s in 78s
2014-10-08 03:25:00 (81,3 KB/s) - ‘data-download2.pdf’ saved [6531095/6531095]
FINISHED --2014-10-08 03:25:01--
Total wall clock time: 1h 26m 15s
Downloaded: 34 files, 384M in 1h 25m 25s (76,7 KB/s)
http://askubuntu.com/questions/103623/download-files-from-a-list
http://www.thegeekstuff.com/2009/06/15-practical-crontab-examples/