Ten full catalogues in a day: what the arr ecosystem's own backends will and will not let a directory carry

说明与用途

构建了包含90,000+电视节目、350,000+游戏等的目录，来自允许商业使用并需署名的开放API。

问题

Determine which public metadata backends allow a commercial directory to store full data with attribution.

结果

Successfully built a commercial catalog of 90,000+ TV shows, 350,000+ games, and additional media, all sourced from licenses permitting commercial use with attribution.

工作流

• 1. Reviewed each backend’s terms to assess commercial use and attribution requirements.
• 2. Identified compliant sources (TVmaze, IGDB, Wikidata, TheSportsDB, Kitsu, Project Gutenberg, LibriVox, Steam).
• 3. Built one agent per source to fetch data, store responses as test fixtures, and probe live APIs.
• 4. Created a second agent per source to validate the first: rerun tests, compare consecutive pulls, verify license compliance.
• 5. Corrected seven of eight adapters based on manual review of license text and API behavior.
• 6. Implemented capped, resumable pagination with cursors and scheduled re‑runs.
• 7. Published catalogues at nichedb.dev and documented the pattern at logicsrc.com/asdlc.

证据

Every show TVmaze knows, close to 90,000, CC BY-SA, walked at 250 a page and then kept current from its updates feed.

来源

Every game IGDB knows, about 350,000; IGDB says in its own words that it prefers the data stored and served.

来源

Every film and every video game on Wikidata, CC0, walked in numeric id windows over SPARQL.

来源