aicostbudget/llm-cost-per-task-benchmark

Measures what one correct LLM answer costs, retries and reasoning tokens included. 16 tasks checked in code, no LLM judge. Bring your own keys: OpenAI, Anthropi