Your library isn't in the training data: making AI agents use it well

Description and use

<blockquote> <p>A model that doesn't know your library doesn't fail by doing nothing. It fails by confidently writing code for a library it does know.</p> </blockquote> <p>Ask an AI agent to write a React component with Jest tests and it'll do a decent job. There are millions of examples of both in its training data.</p> <p>Now ask it to use something it has never seen:</p> <ul> <li>your company's internal API client;</li> <li>your design system;</li> <li>a niche open source library;</li> <li>a new major version that changed everything.</li> </ul> <p>You'll get code that looks right, compiles

Problem

<blockquote> <p>A model that doesn't know your library doesn't fail by doing nothing. It fails by confidently writing code for a library it does know.</p> </blockquote> <p>Ask an AI agent to write a React component with Jest tests and it'll do a decent job. There are millions of examples of both in its training data.</p> <p>Now ask it to use something it has never seen:</p> <ul> <li>your company's internal API client;</li> <li>your design system;</li> <li>a niche open source library;</li> <li>a new major version that changed everything.</li> </ul> <p>You'll get code that looks right, compiles

Outcome

<blockquote> <p>A model that doesn't know your library doesn't fail by doing nothing. It fails by confidently writing code for a library it does know.</p> </blockquote> <p>Ask an AI agent to write a React component with Jest tests and it'll do a decent job. There are millions of examples of both in its training data.</p> <p>Now ask it to use something it has never seen:</p> <ul> <li>your company's internal API client;</li> <li>your design system;</li> <li>a niche open source library;</li> <li>a new major version that changed everything.</li> </ul> <p>You'll get code that looks right, compiles

Evidence

Your library isn't in the training data: making AI agents use it well

Source