What monthly JSON dump?StainlessSteelRat wrote: ↑Mon Jan 18, 2021 11:24 pmthey should at least start from the monthly JSON dump
API Request
Forum rules
API Keys (unique userpage)
Usergroups (request API Users access here after posting a new topic below)
Please provide a basic overview of your proposed use of the API.
Any request lacking this information will be denied pending an appropriate response.
Please do not request keys as end users of another project, as those projects should request and properly implement their own keys. Key requests of this nature will be removed in the interest of more efficiently handling project requests. Assistance may be available upon contact for projects experiencing issues utilizing the current API.
API Keys (unique userpage)
Usergroups (request API Users access here after posting a new topic below)
Please provide a basic overview of your proposed use of the API.
Any request lacking this information will be denied pending an appropriate response.
Please do not request keys as end users of another project, as those projects should request and properly implement their own keys. Key requests of this nature will be removed in the interest of more efficiently handling project requests. Assistance may be available upon contact for projects experiencing issues utilizing the current API.
-
keith.f.kelly
- Posts: 9
- Joined: Wed Nov 28, 2018 2:17 am
Re: API Request
-
keith.f.kelly
- Posts: 9
- Joined: Wed Nov 28, 2018 2:17 am
Re: API Request
I did "mind the whole sentence". It still doesn't make any sense. "Scrapers shouldn't be targeting an app" doesn't make any sense. A scraper is an app. How can an app target an app? And what do you even mean by "target" an app?
Re: API Request
There are few ways to get info: API, SQL dump and JSON dump (viewtopic.php?f=5&t=1947).
For all questions regarding Skyscraper contact its dev.
And you still read only half of original phrase. Explanation is simple - scrapers shouldn't be the type of app that uses API each time users request data. I've already explained most preferrable model of using our API.
For all questions regarding Skyscraper contact its dev.
And you still read only half of original phrase. Explanation is simple - scrapers shouldn't be the type of app that uses API each time users request data. I've already explained most preferrable model of using our API.
Re: API Request
More to the point, and our developers can clarify, there's a huge issue with scrapers not batching queries, instead opting for 1:1 pulls that quickly hit the API limit. This quickly exhausts user limits, where the preferred method would have those projects periodically syncing the full database and correctly batching queries (per every download site ever, admins quickly get irritated by users refusing to queue downloads, either by their own malign intent OR through inaction by the devs responsible for application upkeep).
Our developers can fill in some of the blanks, like implementation of the API or quantification of usage limits; in our case, when correctly implemented, the number of available queries significantly outweighs the current size of the database, with intended options to also pull a semi-regular dump and only update listings that have changed.
Our developers can fill in some of the blanks, like implementation of the API or quantification of usage limits; in our case, when correctly implemented, the number of available queries significantly outweighs the current size of the database, with intended options to also pull a semi-regular dump and only update listings that have changed.
We're curious to see how new projects use TGDB API.
If you have a new public project, please provide a link to it so we can highlight cool new applications!
If you have a new public project, please provide a link to it so we can highlight cool new applications!
-
keith.f.kelly
- Posts: 9
- Joined: Wed Nov 28, 2018 2:17 am
Re: API Request
No, I read the whole thing. What you wrote was simply unclear and non-sensical. I think you overestimate your own English fluency.
Regardless, I finally understand what you were trying to say, thanks to Leo_Pride's answer.
Last edited by keith.f.kelly on Sun Jan 24, 2021 7:39 pm, edited 1 time in total.
-
keith.f.kelly
- Posts: 9
- Joined: Wed Nov 28, 2018 2:17 am
Re: API Request
Then you should re-examine your API documentation, because it's obviously not as clear as you think.
Meanwhile, if skyscraper and other RetroPie-provided scrapers are discouraged, then can you please recommend a scraper (that can produce EmulationStation-compatible gamelist.xml files) that works in the "well behaved" manner you describe? Preferably one that runs on Raspberry Pi?
And if you want people to only use "well behaved" scrapers, your web site should probably maintain a list of "recommended" and "discouraged" scrapers in a prominent spot on the front page. Otherwise, people are just going to keep using whatever RetroPie and its documentation tell them to use.