A 1.5B model is a triage signal, not a verdict

Описание и применение

Модель 1.5 B используется как сигнал‑триажа, а не как окончательное решение: проверка выполняется локально, каждый вывод ограничен одним вопросом и шестью строками контекста, что снижает задержку до ~12 с и повышает прозрачность.

Задача

Auditing trading‑strategy repositories with a 1.5B LLM is too slow for per‑file checks and produces unstable verdicts.

Результат

The redesigned workflow reduces per‑finding latency to ~12 s, eliminates unstable multi‑sentence outputs, and clearly separates deterministic findings from model‑based confirmation, making the audit practical for nightly runs.

Рабочий процесс

• Run deterministic checker to generate findings
• For each finding, extract evidence line + 5 surrounding lines
• Prompt local Qwen2.5‑Coder‑1.5B‑Instruct with yes/no question
• Collect model answers (YES, NO, UNSURE)
• Print report with evidence line and model verdict
• Optionally run --no‑llm for instant deterministic output

Доказательства

The tool runs five deterministic checks over the source, then hands each finding to a local model with exactly six lines of context and one yes/no question: is this actually true here?

Источник

Four model checks on the bundled sample take about 48 to 50 seconds on this laptop. That is roughly twelve seconds per question.

Источник

The model never sees the repository. It sees the finding's evidence line plus five lines around it, and it can answer YES, NO, or UNSURE.

Источник

The checker owns the finding. Every path:line in the report comes from code that matched a pattern.

Источник