Downloading HTML files of a website with wget just give me a index.html
0
votes
2
answers
111
views
I am trying to download 1000 HTML pages from a specific site (https://isna.ir/) with wget in a recursive way (it is part of our course assignment) but it just downloads an index.html file.
I tried a lot of options that wget provides, but none of them work, also I tried
--reject="index.html"
The command:
wget --recursive -nd -np --random-wait -U Googlebot -P ./isna_crawl https://isna.ir/
Asked by Amirali
(5 rep)
Mar 12, 2025, 07:47 AM
Last activity: Mar 13, 2025, 12:34 AM
Last activity: Mar 13, 2025, 12:34 AM