Weird but Effective LLM Tricks: Cache Tree and Tail Prompt Optimization

The project offers “weird but effective” LLM tricks—Cache Tree and Tail Prompt Optimization—that let you add AI capabilities to applications without building a