-
April 27th, 2018, 15:28 #11
Good find Ram.
I'd kinda advise against a multi-threaded wget. Hammering a download server is bad etiquette, normally for a scraper, I put a timing delay, about 1 second between each download and just let it run overnight.
-
April 27th, 2018, 15:45 #12
Thats a good point, although with over 16,000 files, its not likely going to finish overnight. Even with a 1 second delay, that over 4 hours of just delay time for the whole set. Likely take several days, depending on download/upload speeds.
For support with any of my extensions, visit my #mattekure-stuff channel on Rob2e's discord https://discord.gg/rob2e
Thread Information
Users Browsing this Thread
There are currently 1 users browsing this thread. (0 members and 1 guests)
Bookmarks