67 Lines of Bash That Won't Let an LLM Say Done: A Stop Hook That Reads the Transcript JSONL

Description and use

<p>Back when I was a student pulling in ¥100k a month, I thought delegating work came down to three things: ask politely, check in on progress, trust the person. I don't think that anymore. At ¥1.2M a month in revenue, I know trust is something your systems guarantee, not something you extend. LLMs are no different.</p> <h2> Why this mechanism works </h2> <p>Once you start handing implementation work to an LLM, you hit the same wall every time.</p> <p>"Implemented." "Tests pass." "Done."</p> <p>You run it after those three lines and it's broken. Or it does run, but the error handling that actu

Problem

<p>Back when I was a student pulling in ¥100k a month, I thought delegating work came down to three things: ask politely, check in on progress, trust the person. I don't think that anymore. At ¥1.2M a month in revenue, I know trust is something your systems guarantee, not something you extend. LLMs are no different.</p> <h2> Why this mechanism works </h2> <p>Once you start handing implementation work to an LLM, you hit the same wall every time.</p> <p>"Implemented." "Tests pass." "Done."</p> <p>You run it after those three lines and it's broken. Or it does run, but the error handling that actu

Outcome

<p>Back when I was a student pulling in ¥100k a month, I thought delegating work came down to three things: ask politely, check in on progress, trust the person. I don't think that anymore. At ¥1.2M a month in revenue, I know trust is something your systems guarantee, not something you extend. LLMs are no different.</p> <h2> Why this mechanism works </h2> <p>Once you start handing implementation work to an LLM, you hit the same wall every time.</p> <p>"Implemented." "Tests pass." "Done."</p> <p>You run it after those three lines and it's broken. Or it does run, but the error handling that actu

Evidence

67 Lines of Bash That Won't Let an LLM Say Done: A Stop Hook That Reads the Transcript JSONL

Source