Tag — 2 entries
cost-optimization
Every post tagged cost-optimization. Back to the full index →
The Cheap Model Was Fine. Proving It Was the Hard Part.
I built a gateway that sends each prompt to the cheapest Gemini model that can answer it, then benchmarked it on 300 prompts with a Pro-tier judge. The cheap model held up. My test set, my verifier, and my first table of numbers did not. Six lessons for anyone paying an AI bill.
Teaching the Factory to Pick Its Own Tools
My AI dev platform was choosing models with a regex. A $54 accounting bug, one research paper, and a morning of planning later, Composer is building its own complexity-aware model router. Here's the design.