Apple adds multimodal protocols to Foundation Models

// 1h agoPRODUCT UPDATE

Apple adds multimodal protocols to Foundation Models

In the Xcode 27.2 beta, Apple expanded its Foundation Models framework with new Swift protocols designed to enhance multimodal AI interactions. The update introduces DataAttachmentRepresentable for supplying typed binary prompt inputs such as audio and DataEntryRepresentable for structured model outputs.

// ANALYSIS

Apple is methodically maturing its on-device and cloud AI developer stack by standardizing Swift protocols rather than making developers wrangle raw binary buffers.

–**Typed Multimodal Inputs**: DataAttachmentRepresentable provides a clean, protocol-oriented way to inject binary attachments (like audio clips) directly into prompt contexts.
–**Structured Response Handling**: DataEntryRepresentable formalizes model output decoding, moving beyond the clunky custom-segment demos shown previously.
–**Native Ecosystem Polish**: Embedding these abstractions directly within the Foundation Models framework significantly lowers the friction for Apple platform developers building multimodal generative AI experiences.

// TAGS

applexcodefoundation-modelsswiftmultimodal-aillmiosapis

DISCOVERED

1h ago

2026-09-17

PUBLISHED

1h ago

2026-09-17

RELEVANCE

6/ 10

AUTHOR

rudrank

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

OPEN SOURCE35m ago

Hypit and Monid open-source video cloning workflow

Hypit has partnered with Monid to release an open-source agent workflow that deconstructs and clones viral short-form videos inside coding environments like Claude Code. Monid powers the backend as a unified model gateway and pay-per-call billing layer across providers like ByteDance, Alibaba, and ElevenLabs without requiring subscriptions.

LAUNCH1h ago

OpenAI launches ChatGPT for Microsoft Office

OpenAI has released ChatGPT for Microsoft Word, PowerPoint, and Excel across all subscription tiers, enabling users to draft, rewrite, proofread, and format directly inside documents. Business and Enterprise customers also receive an unrestricted two-week preview of the GPT-5.6 Sol model inside Word through September 30.

LAUNCH2h ago

Anthropic opens Life Sciences Verification Program

Anthropic has opened applications for its Life Sciences Verification Program (LSVP), an initiative developed in partnership with the U.S. government to give qualified life sciences researchers access to its frontier models, including Claude Mythos. While standard frontier AI models enforce broad biosecurity safeguards that often trigger false-positive refusals on legitimate scientific tasks, the LSVP establishes a specialized verification tier designed to enable authentic biological and pharmaceutical research without compromising critical safety guardrails against dual-use risks.