Teaching our on-device assistant to say "I don't know"

Description and use

<p><em>We're building <a href="https://www.familiasync.com/" rel="noopener noreferrer">FamiliaSync</a>, an offline-first family organizer where all data stays encrypted on your own devices. That constraint extends to the assistant: every query has to run on the phone, no cloud calls allowed. Here's what happened when we replaced our hand-written intent router with a small on-device classifier.</em></p> <h2> A smarter first step </h2> <p>Every request to the FamiliaSync assistant now starts with a small intent classifier trained on-device. It replaces the hand-written pattern rules that used to

Problem

<p><em>We're building <a href="https://www.familiasync.com/" rel="noopener noreferrer">FamiliaSync</a>, an offline-first family organizer where all data stays encrypted on your own devices. That constraint extends to the assistant: every query has to run on the phone, no cloud calls allowed. Here's what happened when we replaced our hand-written intent router with a small on-device classifier.</em></p> <h2> A smarter first step </h2> <p>Every request to the FamiliaSync assistant now starts with a small intent classifier trained on-device. It replaces the hand-written pattern rules that used to

Outcome

<p><em>We're building <a href="https://www.familiasync.com/" rel="noopener noreferrer">FamiliaSync</a>, an offline-first family organizer where all data stays encrypted on your own devices. That constraint extends to the assistant: every query has to run on the phone, no cloud calls allowed. Here's what happened when we replaced our hand-written intent router with a small on-device classifier.</em></p> <h2> A smarter first step </h2> <p>Every request to the FamiliaSync assistant now starts with a small intent classifier trained on-device. It replaces the hand-written pattern rules that used to

Evidence

Teaching our on-device assistant to say "I don't know"

Source