RetroPie Scraping
RetroPie Scraping
Hi all new to this. I have a RetroPie and would like to scrape all the games using DB. Anyone know how to increase the scrape to 20k games? Thanks
Re: RetroPie Scraping
It wouldn't be by using the legacy scraper, as far as I know.
Skyscraper WAS compliant with batch queuing (which would easily cover that many requests), though I've absolutely no idea if that's still the case.
Skyscraper WAS compliant with batch queuing (which would easily cover that many requests), though I've absolutely no idea if that's still the case.
We're curious to see how new projects use TGDB API.
If you have a new public project, please provide a link to it so we can highlight cool new applications!
If you have a new public project, please provide a link to it so we can highlight cool new applications!
Re: RetroPie Scraping
Can't scrape from thegamesdb.net - known problem? I found this topic and I updated the ES package.
Re: RetroPie Scraping
nano /opt/retropie/configs/all/scraper.conf
Look for a line like maxres="XX" (where XX is the number of maximum results).mapquest Increase this number to your desired limit.
Look for a line like maxres="XX" (where XX is the number of maximum results).mapquest Increase this number to your desired limit.
Last edited by celinecdc on Wed Jan 17, 2024 7:36 am, edited 1 time in total.