Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Your Browser History Is a Dataset: Build a Local, Private Bookmark Brain with a Local LLM

说明与用途

本地化的浏览历史语义索引管道,完成摄取、清洗、可选扩展、嵌入和检索,确保所有数据保留在本地,避免泄露。

问题

Bookmarks and history are hard to retrieve meaningfully; users need a private, semantic search over their own browsing data without exposing it to external services.

结果

A private, semantic bookmark system that indexes a user’s own browsing history locally, avoiding any data leakage to external services, and providing meaningful search results based on meaning rather than exact title matches.

工作流

  • Copy the History SQLite file to a temporary location to avoid lock contention.
  • Run an ingest script that imports new visits incrementally, tracking a watermark to avoid duplicates.
  • Clean the data: strip tracking parameters, remove noise URLs, and apply a denylist to filter sensitive domains before embedding.
  • Optionally enrich: fetch page text for each URL and store a short summary, marking failures explicitly.
  • Embed the cleaned (and enriched) data locally using a local embedding model (e.g., Ollama), storing one vector per URL in a local vector store and recording the model version.
  • Retrieve: embed a user query with the same model, find nearest neighbours, rerank using recency, visit count, and transition type, and present a list of titles with links and source labels.
  • Optionally generate a one‑line summary per result using the local LLM, ensuring every claim links to a clickable URL.

证据

Chromium-based browsers (Chrome, Edge, Brave, and others) store history in a SQLite database file called History.

来源

Chrome locks the file while it runs. Never query the live database in place. Copy it first, then query the copy.

来源

The pipeline is five stages: ingest, clean, enrich, embed, retrieve.

来源

Denylist before embedding, not after. Banking and payment domains, health portals, webmail, password‑reset and one‑time‑code pages, and any URL containing tokens never reach the embedder.

来源

  • 记录日期: 2026-11-01T03:28:47.750Z