Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Show HN: Llmbridge, a C++ LLM gateway with sub-millisecond overhead

Llmbridge is a C++ LLM gateway offering sub‑millisecond latency, enabling rapid integration of language models into existing software. Start by cloning the repo

Original source