Five cards instead of forty notes: a local model that refuses to guess

Описание и применение

Инструмент five‑things позволяет быстро выделить пять наиболее важных заметок из большого каталога, используя локальную модель Gemma 2 2B, ограничивая время и количество запросов, и гарантируя, что каждая карточка содержит подтверждающую цитату.

Задача

A notes folder grows faster than it is read; users need a quick way to identify the five most important notes each week.

Результат

The tool reduces the effort to identify key notes from ~20 minutes to a single command, outputs concise actionable cards, enforces a time budget, and guarantees quote verification to avoid misleading summaries.

Рабочий процесс

• Scan folder for notes and compute ranking signals (age, markers, dates, sections).
• Apply budget allocator to limit to N notes and M minutes of wall‑clock time.
• For each selected note, send text to local Gemma 2 2B model via llama‑cpp to generate a card JSON.
• Validate the generated quote against the note text; if invalid, mark card as unverified and keep note in queue.
• Print the five cards and a list of deferred notes with reasons.
• Cache results keyed on note text to avoid re‑processing on subsequent runs.

Доказательства

five-things brief ~/notes --budget 5 --minutes 2

A quote without a receipt is not a card.

On this laptop, CPU only: Generation, single stream 0.8 to 1.1 tokens per second

The cache is the third saving: cards are keyed on note text, not path, so renaming a file does not burn another call.