Human-in-the-loop QA: let an AI agent run your test sheet on Android, iPhone, web and desktop — and sign off each case yourself

Описание и применение

git-qa позволяет AI выполнять тесты на разных платформах, но человек подтверждает каждый результат, обеспечивая доказательства и ответственность.

Задача

Automated testing tools often claim to run all tests and report passes, but when failures occur the AI’s verdict is not accepted; accountability requires human verification.

Результат

git-qa enables AI to execute tests across devices while a human authorizes each verdict, ensuring accountability and evidence of verification.

Рабочий процесс

• 1. Prepare a TSV test sheet with steps and expected results.
• 2. Install git-qa and Node 22+.
• 3. Launch git-qa, select device/URL/app and test sheet.
• 4. Watch the live screen as the AI runs each step.
• 5. Press 'D' to pass or 'F' to fail when the expected text is found or not.
• 6. Review run.json and screenshots for evidence of each verdict.
• 7. Optionally run unattended with '--no-ui' and review failures later.

Доказательства

git-qa is an open-source human-in-the-loop QA runner built around that fact.

Источник

An AI agent works through your test sheet; you watch the live screen and sign off each case with one key.

Источник

You can run a sheet unattended overnight (--no-ui) and review only the failures in the morning.

Источник