MicroLLM Lab – Try 7 tiny LLM's in the browser
Trending on Hacker News: MicroLLM Lab – Try 7 tiny LLM's in the browser (86 points / 31 comments, via stateofutopia.com)
In one line
Run Q4 small language models entirely in the browser with WebGPU. Chat, benchmark, and compare PetitGPT, SmolLM2, and friends on-device.
Opening excerpt
Objective checks (regex / exact tokens), not writing quality. A 135M model is allowed to fail — that is the measurement. Pick models, then run. Estimate uses your last tok/s if we have one.
Generate and download a verifiable performance certificate with your device hardware, peak and sustained tokens/second, and share your score.
The editor is eval() ’d in this origin, then each check runs on the model’s decoded text.
(Excerpted from the original; full article via the source link below.)
This story hit the Hacker News front page today (86 points / 31 comments, via stateofutopia.com). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.
Source: Hacker News