Apple’s AI features could potentially change the way the iPhone is used

Apple is all set to host its ‘Let Loose’ event on Tuesday, May 7, where it is expected to introduce new iPad Air and iPad Pro models and a new Apple Pencil. However, the Worldwide Developers Conference (WWDC) 2024 on June 10 could be an event worth watching as it could potentially change the company’s approach to its devices, especially the iPhone. It is said that the Cupertino-based tech giant will unveil its artificial intelligence (AI) strategy and introduce new features with iOS 18. Based on papers published by Apple researchers, we can see the company’s vision behind this.

A report Recently published research papers by Apple have been examined in depth by The Verge to highlight that the company is focused on making Siri, the virtual assistant on the iPhone, more efficient and smarter. While this is a huge possibility, there are enough clues to suggest that AI features could completely reshape the way users interact with the iPhone. Although it is unlikely that all of the new capabilities will be rolled out at once, changes may be introduced incrementally over the next few years.

Most of Apple’s published research papers have focused on small language models (SLMs) that can operate independently inside a device. For example, the company published a paper on an AI model called ReALM, which is short for context resolution as a language model. The functionality of this model is described as executing and completing prompted tasks using the relevant language. The description has led to the belief that this model could be used to upgrade Siri.

Another such research paper mentions ‘Ferret-UI’, a multimodal AI model that is “designed to perform precise referencing and grounding tasks specific to UI screens, while allowing open- Competently interprets and acts on end-to-end language instructions.” In short, it can read your screen and perform actions on any interface, be it the home screen, or an app. This functionality could make using the iPhone more intuitive, essentially through verbal commands over finger gestures.

Then there is the keyframer, which Claim It can generate animation from still images and other AI Sample Which can edit images using AI. These capabilities can exponentially improve the Photos app and allow users to make complex edits in simple steps, similar to what DALL-E and MidJourney offer.

However, it should be noted that these speculations are based on research papers published by Apple, and there is no guarantee that these will be turned into a feature. Apple’s vision behind AI will become clearer after the keynote session at WWDC 2024.