Show HN: JevBench, a reproducible benchmark for typed decision models

一句话概要

52 Jev-class systems tested on 534 decisions. Jev 1.13.0 leads JevBench v1.3.0 with 74.4; compare open-source, self-hostable and hosted options.

原文开头节选

Hosting = where inference runs; company = where the provider or lab is registered.

EU hosting means the route’s inference runs inside the EU: an EU region, AWS Bedrock’s EU cross-region (geo) profiles, Azure’s Europe Data Zone, or a provider whose entire public fleet is documented as EU-hosted, each checked per model against the provider’s documentation. Global deployments do not count, and neither does an EU billing region, an EU company or an EU control plane on its own. One disclosed company-policy exception stays in, marked “EU equivalent”.

Evidence requirements (benchmark evidence, priced provider, measured task tokens) sit above the table they apply to.

All tasks is the published default. Choose a scope to see how the ranking changes by difficulty. Hard only uses all 220 hard-tier decisions and their measured Intelligence, Calibration, Speed and Cost.

(以上为原文节选,完整内容见下方”原文来源”)

这条动态今日登上 Hacker News 首页(36 赞 / 4 评论,来源 benchmarkheaven.com)。技术雷达每日自动聚合 AI 工程、后端架构、DevOps 方向的前沿动态;相关工程落地可浏览下方的相关服务与延伸阅读,或直接与我们团队交流。