Is it possible to continue an interrupted
wget
session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget
store additional information to disk (like it's list over parsed and pending links)?
I know the -N option allows wget
to pick-up where it left as long as the server support size and date listing, but the site I was downloading had mostly PHP-generated content, so I don't think -N will work.
I don't expect to continue what I started, but if it's at all possible, I'd like to turn-on anything that will help before retrying, in case I get interrupted again.
+++
I also ran into an additional problem... I got lots of "ERROR 400: Bad Request"... I assume that means I got a bit *too* eager, so the server blocked me and/or the database got overburdened for a while. Anyway, would it be possible to recover from that too? Make wget
basically continue where it left off (after parsing log or link-list or whatever), but also redo pages where it ran into trouble (eg. after I first edited the list).
Asked by Baard Kopperud
(7253 rep)
Aug 28, 2015, 01:47 PM
Last activity: Jan 19, 2024, 02:06 PM
Last activity: Jan 19, 2024, 02:06 PM