Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

NVIDIA will run GLM‑5.3 and Kimi‑K3 for you, for free. I read the fine print. Here are the three catches.

说明与用途

NVIDIA 免费 API 提供 80+ 模型,但每分钟仅限 40 次请求,禁止生产使用,可能将提示用于训练,并经常无预警移除模型。

问题

Users assume NVIDIA’s free AI model endpoint offers unrestricted, production‑ready access, but it imposes hidden limits, data‑usage clauses, and model volatility.

结果

The free NVIDIA endpoint is suitable for single‑threaded chat or low‑throughput agent use, but not for production or high‑fan‑out workloads due to a hard 40 RPM limit, data‑usage clauses, and frequent model removal.

工作流

  • 1. Register for NVIDIA Developer Program (free).
  • 2. Obtain API key (prefix nvapi-).
  • 3. Query https://integrate.api.nvidia.com/v1/models to get current model IDs.
  • 4. Use the OpenAI‑compatible chat completion format to call desired model.
  • 5. Implement exponential backoff for 429 responses; limit to 40 requests per minute per key.
  • 6. Store prompts locally; avoid sending sensitive data that may be used for model training.
  • 7. Monitor build.nvidia.com for model availability and deprecation notices.
  • 8. If higher throughput or production use is needed, purchase NVIDIA NIM deployment.
  • 9. Regularly check the Trial Terms of Service for updates on data usage and production clauses.

证据

"not in production" twice, a clause that lets NVIDIA use your prompts to improve its models

来源

Catch 1: 40 requests per minute, and no way up

来源

The API is ground truth, and it answers without a key: curl https://integrate.api.nvidia.com/v1/models | jq '.data | length' # 80 (15 Oct 2026)

来源

  • 记录日期: 2026-10-15T11:40:58.531Z