Apple Uses AI to Let Vision Pro Users Steer Wheelchairs With Their Eyes

Apple just announced a range of new accessibility features powered by Apple Intelligence, the company’s on-device AI system. One of the standout capabilities allows Vision Pro users to control a compatible powered wheelchair using only their eyes—no hands needed.

This announcement includes updates for iPhone, Mac, and Vision Pro. Enhancements will come to VoiceOver (Apple’s screen reader for blind and low-vision users), Magnifier, and live subtitles. Expect to see these features roll out later this year.

The Eye-Controlled Wheelchair Feature

The main highlight is the Eye-Controlled Wheelchair feature, which connects Apple Vision Pro to a compatible powered wheelchair. With the headset’s eye-tracking technology, users can steer the chair simply by looking in the direction they want to go. It’s like using your gaze as a joystick.

This builds on the Eye Tracking support Apple previously added to iPhone and iPad, allowing users to navigate their screens entirely through eye movements. Taking this concept into the realm of physical mobility marks a big leap for the technology.

Apple hasn’t specified which wheelchair models or manufacturers will be compatible at launch yet.

What Else Is Changing

Natural Language Voice Control

Apple Intelligence will enhance Voice Control, which lets users navigate devices using voice commands. The upcoming update introduces natural language input, letting users speak more normally instead of memorizing specific phrases. Instead of saying “click button one,” a user could say “open my last email from mom.”

VoiceOver Gets Smarter

VoiceOver, the built-in screen reader for Apple devices, will utilize Apple Intelligence to create more detailed descriptions of images and content on the screen. If a photo lacks alt text (a description for visually impaired users), the AI will describe what it detects. This is particularly useful for blind users browsing social media or receiving photos in messages.

Magnifier and Subtitles

The iPhone’s Magnifier app, which helps enlarge text and objects using the camera, will receive AI-driven updates. Live subtitle features will also get improvements, although Apple hasn’t provided details on these changes yet, other than mentioning they’re coming later this year.

What This Means

For many, accessibility features often feel like background software they rarely use. However, these updates signal a significant shift: using AI not just for email summaries or generating images, but for helping restore or enhance physical independence for those who need it most.

If the eye-controlled wheelchair feature works well in real-world conditions, it could be life-changing for individuals with ALS, spinal cord injuries, or other conditions that limit hand and arm movement. The $3,499 Vision Pro headset isn’t cheap, but for someone needing full-time powered mobility assistance, the cost looks quite different than for a tech enthusiast buying it for entertainment.

The natural language Voice Control update is applicable to a broader audience. Anyone who’s tried using voice commands knows how frustrating it can be when the system doesn’t understand. Making this interaction more conversational removes a significant barrier for users with motor impairments who rely on voice as their main input.

Community Reactions

“The wheelchair control via eye tracking on Vision Pro is genuinely impressive. This is the kind of use case that justifies the hardware existing.”

“Good to see Apple putting AI to work on something that actually matters to people’s daily lives instead of just another chatbot feature.”

What To Watch

• WWDC 2026 is likely the event where Apple will reveal which specific software versions include these features and provide a solid release window. The developer conference usually takes place in early June.
• Compatible wheelchair announcements: Apple hasn’t mentioned hardware partners yet. Keep an eye out for third-party wheelchair manufacturers confirming compatibility before or during the launch.
• Later this year rollout: Apple has confirmed the features are coming but hasn’t given a specific month. If past Apple Intelligence rollouts are any indication, expect a phased release starting with US English users.
• Competitor response: Google announced its own accessibility-focused AI updates at Google I/O 2026 on the same day, so both companies are clearly keeping an eye on each other in this area.

Sources: TechCrunch, 9to5Mac, MacRumors