Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

The JVM Speaks AI: Cobrainer's Journey with Kotlin, Koog and Exposed

Описание и применение

Cobrainer объединил интеграцию ИИ в одном Kotlin‑монорепозитории, используя Koog, что обеспечило отказоустойчивость, 5‑кратное увеличение пропускной способности и однодневный выпуск для всех клиентов.

Задача

A large customer triggered a burst of AI‑assisted work, causing one LLM provider to throttle Cobrainer’s services. The system needed a reliable fallback and circuit‑breaking mechanism to keep the workflow uninterrupted.

Результат

By consolidating AI integration into Kotlin with Koog, Cobrainer achieved zero‑downtime during provider throttling, 5× throughput gains, and a single‑day rollout to all customers.

Рабочий процесс

  • 1. Identify LLM framework requirements: lean, explicit, rapid release cadence, clean provider abstractions, end‑to‑end type safety.
  • 2. Evaluate Spring AI, LangChain4j, and Koog by building production‑ready prototypes.
  • 3. Choose Koog for its Kotlin‑centric design and explicit contract handling.
  • 4. Refactor existing AI code to use Koog’s DSL and sealed‑hierarchy contracts.
  • 5. Implement cross‑provider fallback chains and circuit breakers.
  • 6. Deploy the new stack to all customers in one day.
  • 7. Monitor with LLMObs and enforce contract tests.

Доказательства

One afternoon, one of our LLM providers started throttling us. A large customer had triggered a burst of AI‑assisted work, and the provider's capacity in our region could not keep up.

Источник

We built all of our AI integration in Kotlin. ... Every prompt, agent, and structured‑output contract in our core platform lives on the JVM: one Kotlin monorepo with types shared end to end, built on Koog, Exposed, coroutines, and kotlinx.serialization.

Источник

Production reliability comes from cross‑provider fallback chains, circuit breakers, LLMObs, and contract tests. Removing blocking code from coroutine paths also increased throughput by 5×.

Источник

Once we chose Koog, we cleaned up the proof of concept and rolled it out to all customers in one day.

Источник

  • Дата записи: 2026-10-13T08:41:26.204Z