Everyone is building LLM routers, we deprecated ours
Trending on Hacker News: Everyone is building LLM routers, we deprecated ours (66 points / 36 comments, via manifest.build)
In one line
We don’t believe in model routing anymore. For most use cases, sticking to a single battle-tested model is the best thing you can do.
Opening excerpt
Before you go Talk to us and get $25 credit for . We’re doing user discovery to understand your expectations and pain points around agent reliability.
15 minutes through a video call. Quick access to $25 of Gemini tokens through Manifest. You talk and we listen. Just questions and nothing to sell. Book my slot to get $25 Offer terms {this.querySelector(‘.blog-post__share-check’).style.display=‘none’;this.querySelector(‘.blog-post__share-copy’).style.display=‘block’},2000)”> We don’t believe in model routing anymore. For most use cases, sticking to a single battle-tested model is the best thing you can do.
Recently, there’s been huge hype around AI model routers that select the model that will respond to your request on the fly. There have been many launches in recent weeks with similar promises of reducing inference costs. We had our LLM router too, and decided to remove it.
Some context first: we launched the Manifest LLM router in March as a key feature in our LLM gateway , and we deprecated it in June , shutting it down for good on September 1st.
(Excerpted from the original; full article via the source link below.)
This story hit the Hacker News front page today (66 points / 36 comments, via manifest.build). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.
Source: Hacker News