Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

What retrieval missed: a company brain on FalkorDB, tested on 1,203 held‑out questions

Description and use

Retrieval missed contextual relationships; FalkorDB graph tools returned all relevant data, improving answer completeness.

Problem

Retrieval models often miss contextual relationships in enterprise data, leading to incomplete or incorrect answers.

Outcome

The graph‑tool agent retrieved all ten relevant employee IDs for a spec question, whereas retrieval returned only one. In a held‑out question about bug fixes, the agent correctly identified Julia Miller as the top contributor, matching the gold answer, while retrieval named four other engineers.

Workflow

  • 1. Build a FalkorDB graph per product from structured records.
  • 2. Define nine read‑only Cypher tools for querying the graph.
  • 3. Deploy an agent that calls these tools to answer questions.
  • 4. Run the agent on 1,203 held‑out HERB questions.
  • 5. Compare results with retrieval‑based answers and gold answers.

Evidence

I built inherit‑brain for Graph Hacks, Track 3: Company Brain.

Source

The agent made one tool call (doc_people), which ran three read‑only queries in 21.9 ms. It returned ten people.

Source

Julia Miller had two fixing PRs across the four matched bugs, which gave HERB's gold answer.

Source

  • Record date: 2026-10-18T06:41:16.527Z