promptfoo/promptfoo — Test your prompts, agents, and RAGs.

Description and use

promptfoo/promptfoo: promptfoo/promptfoo helps make internal knowledge searchable and usable by assistants.. Use it for index knowledge bases; improve search over documents. Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Problem

promptfoo/promptfoo helps make internal knowledge searchable and usable by assistants.

Outcome

Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Workflow

• index knowledge bases
• improve search over documents
• ground assistant answers

Evidence

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Source