Apple today announced a suite of accessibility updates that use Apple Intelligence to expand capabilities across VoiceOver, Magnifier, Voice Control, and Accessibility Reader, with additional new features for generated subtitles and wheelchair control via Apple Vision Pro.


‌Apple Intelligence‌ powers several of the new features coming later this year:

• VoiceOver Image Explorer uses ‌Apple Intelligence‌ to produce more detailed descriptions of images throughout the system, including photographs, scanned bills, and personal records. Users can also press the Action button on the iPhone to ask questions about what the camera viewfinder sees, with follow-up questions supported in natural language.


• Magnifier brings Apple Intelligence-powered visual descriptions to its high-contrast interface for users with low vision, also accessible via the Action button, with support for spoken commands like "zoom in" or "turn on flashlight."


• Voice Control gains natural language input so users can describe onscreen elements conversationally, such as "tap the guide about best restaurants" or "tap the purple folder," rather than memorizing exact label names or numbers. Apple says the feature can also help where on-screen elements lack proper accessibility labels.


• Accessibility Reader gains support for more complex document layouts including scientific articles with multiple columns, images, and tables, plus on-demand summaries and built-in translation that retains a user's custom font, color, and formatting preferences.


• Generated Subtitles use on-device speech recognition to automatically transcribe spoken audio in uncaptioned video content, including clips recorded on iPhone, received from friends and family, or streamed online, across the iPhone, iPad, Mac, Apple TV, and ‌Apple Vision Pro‌. Initially available in English in the U.S. and Canada.


• Power Wheelchair Control for Apple Vision Pro uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick, launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.

Apple shared a video about the new Voiceover feature:



Apple also announced a number of smaller additions coming later this year:

• Vehicle Motion Cues are coming to visionOS to help reduce motion sickness when using Vision Pro as a passenger in a moving vehicle.


• Apple Vision Pro will support face gestures for performing taps and system actions, plus a new way to select elements with one's eyes while using Dwell Control.


• Made for iPhone hearing aids will gain more reliable pairing and handoff between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.


• Name Recognition, which notifies users who are deaf or hard of hearing if someone says their name, expands to more than 50 languages globally.


• Larger Text support is coming to tvOS, allowing viewers with low vision to increase onscreen text size.


• Sony Access controller is gaining support as a game controller on iOS, iPadOS, and macOS, with full button and thumbstick customization and support for combining two controllers.


• FaceTime gains a new API allowing sign language interpretation app developers to add a human interpreter to an ongoing video call.


• Touch Accommodations gain a new way to personalize setup in iOS and iPadOS.

Starting today, the Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory designed by Los Angeles-based designer Bailey Hikawa, is available globally in three new colors via the Apple Store online. The accessory was developed in collaboration with individuals with disabilities affecting grip, strength, and mobility, and is now available internationally via a partnership with PopSockets.

All of the announced features are expected to arrive later this year. Voice Control's natural language capabilities will be available in English in the U.S., Canada, the UK, and Australia.

Today's announcement is part of Apple's annual tradition of previewing upcoming accessibility features ahead of Global Accessibility Awareness Day, which falls on the third Thursday of May each year. While no firm release date is given for the features, they typically arrive with Apple's new operating system updates in the fall. This year that means iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27, all of which are expected to be unveiled at WWDC in June before shipping in September.
This article, "Apple Previews New Accessibility Features Powered by Apple Intelligence" first appeared on MacRumors.com

Discuss this article in our forums

iOS 27 will include a custom wallpaper generator and an option to automatically create shortcuts using AI, reports Bloomberg.


When choosing a new wallpaper, users will have the option to generate something custom using the Image Playground app. ‌Image Playground‌ is used for generating custom emoji and images that can be used throughout iOS, and it is set to get an upgrade in ‌iOS 27‌.

Apple is testing models that produce more lifelike images, so the version of ‌Image Playground‌ that's used for generating custom wallpapers could be different from the current version.

Shortcuts is also getting a major update, with users able to use natural language to ask Siri to make a shortcut. There is an option for users to tell ‌Siri‌ what they want to accomplish with a shortcut to have the workflow created using AI.

Bloomberg says the Shortcuts app has a prompt that says "What do you want your shortcut to do?" with a text field to enter a description. Shortcuts that are created using AI are then automatically installed and immediately available for use.

Shortcut creation is largely done manually now, and it is a tool that has remained out of reach of many casual iPhone users. A Shortcuts app that's able to work with natural language capabilities will see the app getting more widespread use.

The new Shortcuts app and the wallpaper generation tool will be previewed at the WWDC keynote that's set to take place on June 8.
This article, "iOS 27 to Let Users Generate Wallpapers and Build Shortcuts With AI" first appeared on MacRumors.com

Discuss this article in our forums

iOS 27 and iPadOS 27 will include a revamped AI chatbot version of Siri with new capabilities, but Apple is also planning to introduce new Apple Intelligence features across the operating system, reports Bloomberg.


Apple is testing an expanded version of Writing Tools that will do more rewriting and text generation than the current version. There is a "Write With ‌Siri‌" toggle at the top of the keyboard, along with a "Help Me Write" option that comes up when ‌Siri‌ is activated while a text field is open.

Apple is planning to introduce a dedicated AI grammar checker for Writing Tools that will work like Grammarly. When writing in Messages, Mail, and other apps there will be a translucent menu that slides up from the bottom of the iPhone's screen, and it will show suggested revisions next to the original written text.

Users can go through the suggestions and accept or reject them one by one, approve all of the changes at once, or ignore all of the changes. Apple has an option for pausing grammar checking and for moving between different flagged sections of text. Apple already has a spellchecking feature, but the new feature will add grammar suggestions.

The updates to Writing Tools will be unveiled at Apple's June 8 WWDC keynote. Apple is also planning AI updates for the Photos app, Camera app, and more, with details available in our iOS 27 roundup.
This article, "Apple Expanding AI Writing Tools With Grammar Checker in iOS 27" first appeared on MacRumors.com

Discuss this article in our forums