Text Summarization API: How to Build a Portable Node.js SaaS Chat

说明与用途

构建一个轻量级、可移植的 Node.js 模块，包装聊天 API，验证 JSON 响应，并支持同步和批处理请求，降低供应商锁定风险。

问题

Build a lightweight, vendor‑agnostic text summarization service that turns call transcripts into structured CRM actions.

结果

A minimal, portable Node.js module that abstracts provider differences, validates structured output, and supports both synchronous and batch workflows, reducing engineering overhead for a single‑person SaaS.

工作流

• 1. Define a CallSummary schema with zod.
• 2. Load INFRAI_BASE_URL, INFRAI_API_KEY, INFRAI_MODEL from env.
• 3. Build a fetch request to the chosen provider’s chat endpoint.
• 4. Validate the JSON response against CallSummary.
• 5. If token count exceeds model limit, reject or split the transcript.
• 6. For bulk jobs, submit to a batch endpoint if available.
• 7. Store the validated result for CRM integration.
• 8. Implement retry logic with exponential backoff and retry‑after handling.

证据

Choose a chat-completions API when the input is already text, and put a small adapter around it before shipping.

来源

My default for a one-person SaaS is the thinnest portable boundary that can ship this week. Infrai is a reasonable managed option because an HTTP client is enough: there is no required SDK or client-library version to maintain.

来源

The following Node.js 18+ example uses built-in fetch, so its only runtime dependency is the schema validator.

来源