New AI features coming with iOS 18 are being tested ahead of WWDC, and one of the biggest innovations will be a feature called “Graymatter Catch Up”. This will allow Siri to provide users with an AI-powered summary of the latest notifications.
New AI-powered features coming to Siri in iOS 18
Siri will run on the device and have access to other accounts and information such as calendar events, locations, dates and contacts.
It is thought that these features will be optional and can be enabled or disabled at the user’s discretion, as Apple has been more rigorous about privacy than Google and Samsung.
Thanks to AI improvements, Siri will be able to summarize all kinds of text, from text messages to long articles. Apple also plans to add AI-powered text summarization and transcription features in first-party apps, and offer intelligent responses in Messages, Mail and Siri.
The new and improved Siri will be able to answer questions, summarize long articles and transcribe voice memos on the device. What can’t be done on the device will be handled by Ajax LLM or cloud-based processors. These features, which we’ve seen in Microsoft’s OneNote and Otter apps, show that Apple wants to compete.
Apple is also working on AI-powered accessibility features such as more natural voices and text-to-speech improvements. Finally, Siri is expected to get better at cross-device media and TV controls.
AppleInsider notes that users will be able to use Siri on Apple Watch to play music on another device, but this feature will likely not be available until late 2024.
While Siri’s AI features are the most intriguing, other apps haven’t been forgotten. iOS 18 and macOS 15 are adding AI-powered photo editing features to the Photos app. Users will be able to remove objects and people from the background using the “Clear” feature, similar to Google’s Magic Eraser. This will replace Apple’s existing Retouch tool.
Apple also plans to introduce an AI feature called “Generative Playground”. This will be a generative AI that can create and edit images. It will offer various features such as iMessage integration and custom emojis. It is also possible that this feature will be integrated into the notes app.
Finally, Math Notes will be integrated into Apple’s new GrayParrot Calculator app. Aimed at students, this app will recognize mathematical equations and provide solutions, such as autocomplete for text. It will also be able to create graphs, making homework much easier.
{{user}} {{datetime}}
{{text}}