smg-project/smg helps turn isolated prompts and tools into repeatable agent workflows

说明与用途

smg-project/smg 是一种基于 Rust 的引擎无关的 LLM 网关，提供完整的 OpenAI 与 Anthropic API 兼容性，支持 vLLM、TRT‑LLM、TokenSpeed、SGLang、OpenAI、Gemini 等多种后端，并具备 gRPC 流水线、KV 缓存感知路由、聊天历史、token 缓存、Responses API、嵌入式、WASM 插件、MCP 以及多租户认证等功能，帮助将零散的 Prompt 和工具转化为可重复的 Agent 工作流。典型接入方式包括通过其提供的 HTTP/REST、gRPC 或 CLI/SDK 调用统一的 API 入口，或在服务中直接嵌入其网关库进行路由与缓存管理。凭借最近的活跃维护、强

问题

smg-project/smg helps turn isolated prompts and tools into repeatable agent workflows.

结果

High for an OSS candidate: recent activity, adoption, and ecosystem signals are strong enough for a serious pilot.

工作流

• coordinate multi-agent workflows
• add tool-use pipelines
• standardize agent memory

证据

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

来源