一句话概要

Ollaya downloads and serves open decision models on your own machine. Typed, calibrated answers in milliseconds — private and open source.

原文开头节选

Ask typed questions about any text or JSON and get calibrated answers in milliseconds. Private, open source, on your own hardware.

A decision model answers in a single forward pass, with no token-by-token generation. On your own GPU, a five-question request to Laya takes about 10 ms, end to end through the HTTP API.

Ollaya serves /v1/systemone and /v1/models with TypeSafe’s request and response shapes. The official TypeSafe Python SDK 0.7.1 works unchanged against a local server.

Point the TypeSafe SDK at Ollaya export TYPESAFE_BASE_URL = http://localhost:11435 export TYPESAFE_API_KEY = local # any value works export TYPESAFE_DEFAULT_MODEL = laya # …or call the compatible endpoint directly curl http://localhost:11435/v1/systemone -d ’ { “model” : “laya” , “state” : “Can I get an invoice for last month?” , “questions” : { “intent” : { “type” : “choice” , “instructions” : “What does the customer want?” , “criteria” : { “invoice” : “Needs an invoice or receipt” , “refund” : “Wants money back” , “other” : “Anything else” } } } } ’ Response

(以上为原文节选,完整内容见下方”原文来源”)

这条动态今日登上 Hacker News 首页(210 赞 / 67 评论,来源 ollaya.dev)。技术雷达每日自动聚合 AI 工程、后端架构、DevOps 方向的前沿动态;相关工程落地可浏览下方的相关服务与延伸阅读,或直接与我们团队交流。