shell-nlp/gpt_server — Gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。

Description and use

Shell‑NLP’s **gpt_server** is an open‑source framework designed for production‑grade deployment of large language models (LLMs) and related AI services, including embeddings, reranking, automatic speech recognition (ASR), text‑to‑speech (TTS), text‑to‑image generation, image editing, and text‑to‑video creation. It provides a unified backend that abstracts model hosting, inference routing, and API management, enabling developers to integrate a wide range of generative AI capabilities into their applications with minimal effort.

Problem

shell-nlp/gpt_server helps make internal knowledge searchable and usable by assistants.

Outcome

Early or unclear: treat as research material until maintenance, releases, docs, and issue activity are verified.

Workflow

• index knowledge bases
• improve search over documents
• ground assistant answers

Evidence

gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。

Source