Apple has announced a new set of accessibility updates powered by Apple Intelligence that are coming later this year across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Apple states that these new features will improve how users with visual, hearing, physical, and learning disabilities interact with Apple devices. The updates include more detailed image descriptions in VoiceOver, natural language navigation in Voice Control, AI-generated subtitles for videos without captions, and new eye-tracking wheelchair controls on Apple Vision Pro.
“Apple’s approach to accessibility is unlike any other,” said Tim Cook, Apple’s CEO. “Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.”
“The accessibility features our users rely on every day become even more powerful with Apple Intelligence,” said Sarah Herrlinger, Apple’s senior director of Global Accessibility Policy and Initiatives. “With these updates, we’re bringing new, intuitive options for input, exploration, and personalization — designed to protect users’ privacy at every step.”
VoiceOver and Magnifier
For users who are blind or have low vision, VoiceOver and Magnifier can describe onscreen information or a user’s surroundings. With Apple Intelligence, these essential tools become even more powerful. The Image Explorer in VoiceOver uses Apple Intelligence to give more detailed descriptions of images systemwide, including what’s in photographs, scanned bills, personal records, and other visual content. With updates to Live Recognition, VoiceOver users can press the Action button on iPhone to quickly ask a question about what’s in the camera viewfinder and get a detailed response. Users can also ask follow-up questions in their own words to get more visual information.
Magnifier uses Apple Intelligence to bring the same assistive exploration and visual description to a high-contrast interface designed for users who have low vision. Magnifier also works with the Action button so users can quickly ask questions and get answers. And users can control the app itself with spoken requests, such as “zoom in” or “turn on flashlight.”
Voice Control Gets Natural Language
With Apple Intelligence, Voice Control becomes more intuitive than ever, using natural language to help users with a range of physical disabilities navigate iPhone and iPad entirely by voice. With a new flexible input, users can describe onscreen buttons and controls with natural language instead of memorising exact labels or numbers. The option to “say what you see” is great for navigating any app, including those with visual layouts such as Apple Maps or Files, using intuitive language like “tap the guide about best restaurants” or “tap the purple folder.” This can also help users overcome barriers when elements aren’t properly labeled for accessibility.
See What’s Next in Tech With the Fast Forward Newsletter
Tweets From @varindiamag
Nothing to see here - yet
When they Tweet, their Tweets will show up here.
