Sample Header Ad - 728x90

Continuing an interrupted `wget` session?

1 vote
1 answer
2021 views
Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over parsed and pending links)? I know the -N option allows wget to pick-up where it left as long as the server support size and date listing, but the site I was downloading had mostly PHP-generated content, so I don't think -N will work. I don't expect to continue what I started, but if it's at all possible, I'd like to turn-on anything that will help before retrying, in case I get interrupted again. +++ I also ran into an additional problem... I got lots of "ERROR 400: Bad Request"... I assume that means I got a bit *too* eager, so the server blocked me and/or the database got overburdened for a while. Anyway, would it be possible to recover from that too? Make wget basically continue where it left off (after parsing log or link-list or whatever), but also redo pages where it ran into trouble (eg. after I first edited the list).
Asked by Baard Kopperud (7253 rep)
Aug 28, 2015, 01:47 PM
Last activity: Jan 19, 2024, 02:06 PM