I raced six models against each other on DigitalOcean Inference. The cheapest one won.
Описание и применение
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used...
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used last time, or whatever I read about most recently, and I tell myself I'll benchmark it properly later, and later never arrives because there is always something with an actual deadline on it and comparing model latencies feels like procrastination even when it isn't. I never do it. Not once.
So I built the thing that would make me do it. One prompt, fired at six models at once, streaming side by s
Задача
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used...
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used last time, or whatever I read about most recently, and I tell myself I'll benchmark it properly later, and later never arrives because there is always something with an actual deadline on it and comparing model latencies feels like procrastination even when it isn't. I never do it. Not once.
So I built the thing that would make me do it. One prompt, fired at six models at once, streaming side by s
Результат
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used...
Every time I put a model behind an endpoint I make the same lazy decision. I pick whatever I used last time, or whatever I read about most recently, and I tell myself I'll benchmark it properly later, and later never arrives because there is always something with an actual deadline on it and comparing model latencies feels like procrastination even when it isn't. I never do it. Not once.
So I built the thing that would make me do it. One prompt, fired at six models at once, streaming side by s
Доказательства
I raced six models against each other on DigitalOcean Inference. The cheapest one won.
- Дата записи: 2026-09-09T16:15:34.600Z