Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

Apple Announces New AI and ML Powered Eye Tracking and Music Haptics Accessibility Features

Share

Apple announced several new accessibility-focused features for its iPhone and iPad devices on Wednesday. The company regularly introduces new accessibility features to make the devices easier to use for those who suffer from physical disabilities. This year, the tech giant is bringing a new Eye Tracking feature that will allow users to control their device with just eye movements. Additionally, Music Haptics will let users experience music via vibrations, and Vocal Shortcuts will let them perform tasks with custom sounds.

The features were announced via a post on the company’s newsroom. Apple’s senior director of Global Accessibility Policy and Initiatives, Sarah Herrlinger said, “Each year, we break new ground when it comes to accessibility. These new features will make an impact in the lives of a wide range of users, providing new ways to communicate, control their devices, and move through the world.”

First, the Eye Tracking feature offers users a built-in option for operating iPhone and iPad with just eye movements. Powered by artificial intelligence (AI), this feature uses the front camera which can be calibrated with the user’s eyes and the on-device machine learning (ML) features track the eyes to let people with physical disabilities easily navigate through the phone. The company says that it does not have the access to the user data.

Music Haptics is another new feature that offers a unique way for users to experience music who suffer from hearing impairments. The feature, on iPhone, leverages the Taptic Engine to play taps, textures and vibrations to match the audio of the music. Apple says the feature can play millions of songs in the Apple Music catalogue. It will also be available as an API for developers to integrate it in their music apps.

Next, Vocal Shortcuts for iPhone and iPad users is designed to help people suffering from speech-related disabilities. It allows users to set custom utterances that can be understood by Siri to launch shortcuts and complete tasks. Further, a new feature dubbed Vehicle Motion Cues adds animated dots on the edges of the screen to reduce sensory conflict between what a person sees and feels. Citing research, Apple said this conflict is one of the main reasons behind motion sickness, and the feature can reduce such symptoms.

Apart from these, CarPlay is also getting voice control, sound recognition, and colour filters to help users with various disabilities. Apple’s newest product line, Vision Pro is also getting a system-wide live caption feature for those with hearing difficulties.


Affiliate links may be automatically generated – see our ethics statement for details.