NOAA Precipitation Frequency Data Server

Issue #21 resolved
Borislav Iordanov created an issue

http://hdsc.nws.noaa.gov/hdsc/pfds/

and

ftp://hdsc.nws.noaa.gov/pub

See the commands used in the comments.

Comments (11)

  1. Sakari Albert Maaranen

    Using:

    nice -5 wget --convert-links --mirror --no-parent --no-remove-listing --follow-ftp --no-verbose --output-file=hdsc.nws.noaa.gov_ftp.log ftp://hdsc.nws.noaa.gov/pub
    
    nice -5 wget --wait=4 --random-wait --prefer-family=IPv4 --dns-timeout=10 --connect-timeout=20 --read-timeout=120 --tries=40 --mirror --no-parent --no-remove-listing --follow-ftp --no-verbose --output-file=hdsc.nws.noaa.gov_http.log http://hdsc.nws.noaa.gov/hdsc/pfds/
    
  2. Sakari Albert Maaranen

    The website:

    FINISHED --2017-01-24 00:09:39--                                           Total wall clock time: 4m 57s
    Downloaded: 64 files, 9.4M in 28s (350 KB/s)
    

    The FTP still in progress.

  3. Sakari Albert Maaranen
    FINISHED --2017-01-25 13:46:41--
    Total wall clock time: 17h 38m 14s
    Downloaded: 39994 files, 43G in 10h 24m 4s (1.17 MB/s)
    
  4. Log in to comment