Apple announced new features for iOS 18

Samet Kelebek

May 15, 2024

Apple has announced new accessibility features for iOS 18 and iPadOS 18, which are likely to be released later this year, reaffirming its commitment to inclusivity and innovative design. This will allow Apple to provide enhanced user experiences for individuals with disabilities, leveraging the latest technology innovations in both hardware and software, particularly advancements in artificial intelligence and machine learning.

Eye Tracking for iPad and iPhone

One of the most iOS 18 anticipated features, Eye Tracking, enables physically disabled users to control their devices solely with their eyes. This feature utilizes the front camera for setup and calibration, with all data stored on the device to ensure privacy. Eye Tracking works in conjunction with iPadOS and iOS applications, compatible with functions such as physical button activation and motion control.

Music Haptics for Hearing-Impaired Users

Music Haptics introduces a new dimension to the music experience for hearing-impaired users. Using the Taptic Engine, this feature converts sound into tactile feedback, providing a sensory experience through taps, textures, and refined vibrations. Integrated with Apple Music, this feature will be provided to developers as an API to enhance their applications.

Innovations in Speech and Communication

With Vocal Shortcuts, users can assign specific sounds that Siri can recognize to perform tasks and initiate shortcuts. Additionally, the Unusual Speech Listening feature enhances speech recognition capability for users with conditions that affect speech, such as cerebral palsy or ALS. This builds upon previous efforts to support users who are non-verbal or at risk of losing speech abilities.

Vehicle Motion Cues to Reduce Motion Sickness

Vehicle Motion Cues aim to reduce motion sickness by pairing animated dots on the screen with vehicle movement. This feature utilizes built-in sensors to detect when the user is in a moving vehicle, providing visual cues that reduce sensory conflict without interrupting the main content.

CarPlay and visionOS Improvements

CarPlay gains accessibility with Voice Control, Color Filters, and Speech Recognition, making it more accessible to users with diverse needs. visionOS will offer features such as Live Captions, enhanced support for hearing aids made for iPhone, and other visual accessibility features.

Additional Updates and Features

• VoiceOver: New voices, customizable keyboard shortcuts, and flexible Speech Rotator.
• Magnifier: Quick launch of Reader Mode and Motion Detection Mode.
• Braille Support: Enhanced Braille Screen Input, multi-line braille support, and more.
• Personalized Voice: Now available in Mandarin Chinese.
• Live Text: Compatibility will be increased with Categories and Live Captions.
• AssistiveTouch: Virtual Touch Surface will be added for device control.
• Switch Control: Gesture recognition for finger touch movements will be added.
• Voice Control: Support for custom word vocabulary and complex words.

At the WWDC event in June, Apple is expected to empower all these features with artificial intelligence under the OpenAI partnership, potentially advancing to the AGI level.