Earned Automony

Описание и применение

Построена полностью автоматизированная система генерации новостных статей, которая проходит строгие метрики качества и продвигается по ступеням автономии, начиная с теневого режима и заканчивая полностью автономным публикацией.

Задача

How to safely let an LLM publish content to production without human oversight while ensuring quality and trust.

Результат

The pipeline achieved $2.26 cost per article, 0 banned phrases, 1.0 structure score, 0.98 groundedness, and maintained a 4.0 mean persona adherence. It moved from shadow to autonomous in eight weeks, publishing 69 articles weekly without human intervention.

Рабочий процесс

• 1. Pull weekly source articles from feeds
• 2. Cluster similar stories and deduplicate
• 3. Run novelty check to filter duplicates
• 4. Cap topics to a limited set
• 5. Rewrite 69 articles using four editorial voices
• 6. Generate images for each article
• 7. Write rewritten content and images to production database
• 8. Trigger site rebuild and search index refresh
• 9. Log all outputs
• 10. Run mechanical quality checks (structure, groundedness, banned phrases)
• 11. Sample articles for claim verification by a Haiku judge
• 12. Score articles with a multi‑judge persona panel
• 13. Store scorecard and telemetry in blob storage
• 14. If all metrics meet thresholds, promote to next rung; otherwise demote

Доказательства

If you'd asked me eighteen months ago whether I would let a language model publish to production with no human in the loop, I would have said no

Источник

The summary landed in blob storage next to the telemetry: banned phrases 0, structure 1.0, groundedness 0.98, and cost $2.26.

Источник

The rewrite stage of my pipeline is on rung four.

Источник