I built a notes search that never phones home (23 MB model, one JSON file)

说明与用途

slothbox 是一个本地语义搜索工具，使用开放权重模型，将索引存储在单个 JSON 文件中，完全离线运行。

问题

Existing note‑search products require sending user text to external servers, an API key, and a credit card, making it costly and privacy‑concerned for personal note collections.

结果

slothbox builds a 23 MB model index in ~3 s, embeds 5 files in under 2 s, produces ~60 KB JSON, and makes zero network calls after the first run, enabling fast, private, unmetered note search.

工作流

• 1. Run node sloth.mjs index ./notes to build the index.
• 2. Query with node sloth.mjs ask "question" to retrieve relevant passages.
• 3. The tool skips unchanged files, saves progress after each file, and sleeps 80 ms between files to run in background.

证据

Every "ask your notes" product I tried wanted the same three things: my text on their server, an API key with a monthly ceiling, and a credit card.

来源

The whole index is one JSON file next to your notes.

来源

After that there are zero network calls. I verified this the boring way: ran the same query with the Hugging Face hub disabled (HF_HUB_OFFLINE=1) and got the same answer, with no network access.

来源

Model load, first call ~3.1 s; Embed 5 files / 5 passages under 2 s; Store size, 5 passages ~60 KB of JSON; Network calls after the first run 0.

来源

Retrieval is not understanding. Passage-level cosine similarity finds the right paragraph and then stops.

来源