Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
Trending on Hacker News: Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents (99 points / 43 comments, via github.com)
In one line
Open source inference engine for agents that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU. - magnitudedev/magnitude
Opening excerpt
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} magnitudedev / magnitude Public Notifications You must be signed in to change notification settings Fork 397 Star 5.7k main Branches Tags Go to file Code Open more actions menu Latest commit History 1,050 Commits 1,050 Commits Folders and files Name Name Last commit message Last commit date .agents/ skills .agents/ skills .changeset .changeset .github .github assets assets cli cli design design desktop desktop docs docs inference-v2 inference-v2 inference-v3 inference-v3 inference-v4 inference-v4 inference inference info info integrations/ pi integrations/ pi old-inference old-inference packages packages patches patches scripts scripts specs/ 26-09-23 specs/ 26-09-23 web web .dockerignore .dockerignore .gitignore .gitignore .gitmodules .gitmodules AGENTS.md AGENTS.md CONTRIBUTING.md CONTRIBUTING.md LICENSE LICENSE README.md …
(Excerpted from the original; full article via the source link below.)
This story hit the Hacker News front page today (99 points / 43 comments, via github.com). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.
Source: Hacker News