In one line

Ollaya downloads and serves open decision models on your own machine. Typed, calibrated answers in milliseconds — private and open source.

Opening excerpt

Ask typed questions about any text or JSON and get calibrated answers in milliseconds. Private, open source, on your own hardware.

A decision model answers in a single forward pass, with no token-by-token generation. On your own GPU, a five-question request to Laya takes about 10 ms, end to end through the HTTP API.

Ollaya serves /v1/systemone and /v1/models with TypeSafe’s request and response shapes. The official TypeSafe Python SDK 0.7.1 works unchanged against a local server.

Point the TypeSafe SDK at Ollaya export TYPESAFE_BASE_URL = http://localhost:11435 export TYPESAFE_API_KEY = local # any value works export TYPESAFE_DEFAULT_MODEL = laya # …or call the compatible endpoint directly curl http://localhost:11435/v1/systemone -d ’ { “model” : “laya” , “state” : “Can I get an invoice for last month?” , “questions” : { “intent” : { “type” : “choice” , “instructions” : “What does the customer want?” , “criteria” : { “invoice” : “Needs an invoice or receipt” , “refund” : “Wants money back” , “other” : “Anything else” } } } } ’ Response

(Excerpted from the original; full article via the source link below.)

This story hit the Hacker News front page today (210 points / 67 comments, via ollaya.dev). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.