Can your tool test tell a wrong answer from a valid response?

Описание и применение

Тесты Nobulex выявляют случаи, когда инструмент возвращает синтаксически корректные, но семантически неверные данные, позволяя разработчикам быстро обнаруживать и исправлять ошибки.

Задача

Tool returns a response that appears successful but is materially incorrect, such as wrong date ranges in historical data queries.

Результат

The self‑test detects when a tool returns data that is syntactically correct but semantically wrong, enabling developers to identify and fix material errors.

Рабочий процесс

• Clone the Nobulex registry repository
• Navigate to the repository directory
• Run the self‑test script with Python 3.11+
• Review test output for failures indicating incorrect data

Доказательства

the useful part to try first is the self-test. it includes planted failures and clean controls.

Источник