← Back to Tech Radar
Hacker News tech

Everyone is building LLM routers, we deprecated ours

Trending on Hacker News: Everyone is building LLM routers, we deprecated ours (66 points / 36 comments, via manifest.build)

In one line

We don’t believe in model routing anymore. For most use cases, sticking to a single battle-tested model is the best thing you can do.

Opening excerpt

Before you go Talk to us and get $25 credit for . We’re doing user discovery to understand your expectations and pain points around agent reliability.

15 minutes through a video call. Quick access to $25 of Gemini tokens through Manifest. You talk and we listen. Just questions and nothing to sell. Book my slot to get $25 Offer terms {this.querySelector(‘.blog-post__share-check’).style.display=‘none’;this.querySelector(‘.blog-post__share-copy’).style.display=‘block’},2000)”> We don’t believe in model routing anymore. For most use cases, sticking to a single battle-tested model is the best thing you can do.

Recently, there’s been huge hype around AI model routers that select the model that will respond to your request on the fly. There have been many launches in recent weeks with similar promises of reducing inference costs. We had our LLM router too, and decided to remove it.

Some context first: we launched the Manifest LLM router in March as a key feature in our LLM gateway , and we deprecated it in June , shutting it down for good on September 1st.

(Excerpted from the original; full article via the source link below.)

This story hit the Hacker News front page today (66 points / 36 comments, via manifest.build). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.

Source: Hacker News

Related Services

Related Reading