Foundation Models Framework (macOS)

In one line

The Foundation Models framework is a native Swift API for integrating any large language model into your app.

Opening excerpt

The Foundation Models framework is the best way to use any large language model in your app. Whether you’re generating a quick summary or creating dynamic agents, the framework has what you need.

What’s new in the Foundation Models framework Meet the Foundation Models framework Foundation Models framework Human Interface Guidelines for Generative AI Image understanding Multimodal prompts let you pass images alongside text so your app can reason about visual content. This opens up new categories of experiences you can build with image understanding — it’s as simple as attaching an image to your prompt. The Vision framework is also integrated directly, giving your model purpose-built tools like OCR for precise text extraction and barcode readers for quick code scanning — all on-device.

What’s new in image understanding Model support The Foundation Models framework gives you direct access to the on-device foundation model at the core of Apple Intelligence so you can build experiences that are smart, private, and work without internet connectivity.

(Excerpted from the original; full article via the source link below.)

This story hit the Hacker News front page today (25 points / 3 comments, via developer.apple.com). Our Tech Radar aggregates daily signals on AI engineering, backend architecture and DevOps — browse the related services and further reading below, or get in touch with our team.