Building an AI Devil's Advocate: A Multi-Agent Debate App with LangGraph & Streamlit

Описание и применение

Приложение «AI Devil's Advocate» демонстрирует устойчивую многопользовательскую систему дебатов, автоматически переключающую LLM‑провайдеры при превышении лимитов запросов, сохраняя непрерывность работы и предоставляя экспорт транскриптов.

Задача

Managing API rate limits while running a multi-agent debate application.

Результат

The app demonstrates a resilient multi‑agent debate system that automatically switches LLM providers on rate‑limit errors, maintaining continuous operation and providing a polished UI with transcript export and usage monitoring.

Рабочий процесс

• Configure multiple LLM providers in llm_factory.py
• Wrap providers with FallbackLLMWrapper
• Run debate agents via LangGraph state machine
• If a 429 error occurs, wrapper routes prompt to next provider
• Continue debate until verdict is generated
• Export transcript as PDF or Markdown
• Display real‑time API call counter in sidebar

Доказательства

If the primary LLM throws a 429 Too Many Requests error, the wrapper catches it and immediately routes the prompt to the next available provider in the list.

Источник

Multi-Provider Architecture: Switch between Groq, Gemini, and OpenRouter on the fly.

Источник