Page 1 of 1
RetroPie Scraping
Posted: Mon Feb 27, 2023 3:04 am
by acons017
Hi all new to this. I have a RetroPie and would like to scrape all the games using DB. Anyone know how to increase the scrape to 20k games? Thanks
Re: RetroPie Scraping
Posted: Sat Apr 15, 2023 6:24 am
by Leo_Pride
It wouldn't be by using the legacy scraper, as far as I know.
Skyscraper WAS compliant with batch queuing (which would easily cover that many requests), though I've absolutely no idea if that's still the case.
Re: RetroPie Scraping
Posted: Thu Jan 04, 2024 9:36 am
by mountchav
Can't scrape from thegamesdb.net - known problem? I found this topic and I updated the ES package.
Re: RetroPie Scraping
Posted: Wed Jan 17, 2024 7:36 am
by celinecdc
nano /opt/retropie/configs/all/scraper.conf
Look for a line like maxres="XX" (where XX is the number of maximum results).
mapquest Increase this number to your desired limit.