Apple Vision Pro Gets Major AI Upgrade With VisionOS 2.4: All New Features Explained
Apple has released the VisionOS 2.4 update for its Vision Pro platform. This update brings AI-powered features such as generative AI image creation and AI photo search. Users can also benefit from smart reply and spatial computing capabilities integrated into the system. Apple's focus on intelligence and innovation is evident in these new features. The VisionOS 2.4 update promises to enhance the user experience with advanced AI technologies.
Apple Vision Pro Update
Apple has rolled out the visionOS 2.4 update for the Apple Vision Pro, introducing a significant wave of AI-powered features under the Apple Intelligence umbrella. This marks a major step forward for the mixed reality (MR) headset, adding tools designed to enhance writing, image generation, and photo search capabilities.
Key Features in VisionOS 2.4
The update is available to users with their device and Siri language set to English (US). Apple highlighted the enhancements in a newsroom post, detailing the AI-driven upgrades now accessible on the headset.
Writing Tools: Smarter Text Editing and Summarization
The Writing Tools feature is now live on the Apple Vision Pro, bringing AI-powered support for composing, rewriting, and proofreading. It can check spelling and grammar, summarize text, create lists and tables, or even highlight key points—making content creation much more efficient.
Image Playground: AI-Generated Art and Emojis
A new app called Image Playground uses generative AI to create images based on user prompts. You can even choose a reference person from your Photos app and apply different artistic styles. The app also introduces Genmoji, a feature that allows users to generate custom emojis in the same way. These can be added to messages, shared as stickers, or used as Tapback reactions.
Smarter Photo Search and AI-Powered Memory Movies
With Apple Intelligence, users can now search their Photos app using natural language queries, making it easier to find specific memories. Additionally, the Create a Memory Movie feature lets AI generate a story with themed chapters based on selected photos. The AI arranges the images into a structured movie with a narrative arc, all based on the prompt provided.
Enhanced Messaging and Notifications
Apple has also introduced Smart Reply for Mail and Messages, enabling quick and contextually relevant responses. Other AI-powered additions include:
- Priority Messages in Mail
- Mail Summaries
- Image Wand in Notes
- Priority Notifications in the Notification Center
- Notification Summaries
Apple reassures users that privacy remains a top priority. "Photos and videos used to create movies and other actions are kept private and not shared with the company," the company states. Wherever possible, on-device processing is used to protect user data. For tasks requiring more advanced AI models, Apple employs Private Cloud Compute, ensuring that users’ data is never stored or shared.
With visionOS 2.4, Apple is making the Vision Pro more powerful, creative, and intuitive than ever.