Desert Ant Labs: local, fast models that run on device
Trending on Hacker News: Desert Ant Labs: local, fast models that run on device (356 points / 87 comments, via desertant.com)
In one line
We’re building a frontier lab for on-device AI. Small, specialized models for audio, vision, and text, faster than the cloud and free.
Opening excerpt
Today we’re launching Desert Ant Labs, a European frontier AI lab building opinionated on-device intelligence. We believe the best path to efficient intelligence starts on-device.
We’re building small, specialized models for audio, vision, and text – each model answers in milliseconds, and costs nothing to run, so you can put intelligence in every product interaction, without being limited by token cost or inference speed. Small enough to run on a five-year-old phone, fast enough to use on every frame or keystroke, and better than the API call you’re already paying for.
The first 18 models are live today (12 stable and six in beta), accessible via one SDK for Swift, Kotlin, and JavaScript. One model per task, each built to be the fastest way to complete that task on a device:
And that’s just to name a few. You can find full specs and benchmarks for the other fourteen, on desertant.com/models and Hugging Face . Every model is free up to 100k monthly active devices. No tokens, no logins.
(Excerpted from the original; full article via the source link below.)
This story hit the Hacker News front page today (356 points / 87 comments, via desertant.com). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.
Source: Hacker News