On June 10, during the WWDC 2024 presentation in Cupertino, Apple announced the integration of ChatGPT into Siri, iOS, iPadOS, and macOS, alongside the imminent launch of a large-scale initiative called Apple Intelligence, which aims to incorporate artificial intelligence into the company’s devices.
TechCrunch explored how Siri will change after the update.
ChatGPT Integration on iPhone
Siri will be able to connect to ChatGPT to answer specific questions. For instance, if you need ideas for cooking with available ingredients.
To refine a query, you can send photos. For example, you can take a picture of a flower growing outside and ask Siri for information about it.
Sending requests to ChatGPT will not require account registration, but Siri will need permission to connect to the chatbot.
Understanding Personal Context
Apple Intelligence will enable Siri to understand the user’s personality and perform actions characteristic of them. For instance, if a recipe was received on the device a few days ago via text or email and is now hard to find, asking “Siri, show me the recipe Alice sent a few days ago” will resolve the issue.
Another example: during flight booking, you can quickly find your passport number through the assistant; Siri will extract it from an email or photo and automatically enter it into the required field.
Improved Speech Recognition
Apple has enhanced the understanding of natural speech with hesitations. For example, the personal assistant will comprehend a request like: “Siri, set an alarm for, oh no, set a timer for 10 minutes. Actually, set it for five minutes.”
Siri better understands context. You can ask the assistant about the location of a family meeting, then inquire about the weather there without mentioning the location again.
Text Communication
Previously, interaction with the personal assistant on iPhone was voice-only. With Apple Intelligence, a text input feature will be added for situations where speaking is not possible or desired. Text input ensures that the request is clearly understood.
Siri’s Enhanced Understanding of Apple Products
Siri now has a better grasp of the features and specifics of the devices it operates on. You can ask the assistant how to schedule a message and receive a step-by-step guide.
Understanding On-Screen Content
Siri understands the information displayed on the screen and can take actions based on the viewed content. For example, if a user receives an address from a friend, Siri can immediately add it to a contact card.
When offered to watch a TV show on Apple TV+, the assistant can open it right away.
Actions Within Apps
Apple Intelligence adds the ability to perform actions within and between apps. For instance, you can ask Siri to enhance a photo in the Photos app and then send it to a specific person in a message.
Apple has postponed the launch of Apple Intelligence in the EU until at least 2025 due to local regulations.
Earlier, media reported on the company’s efforts to integrate AI tools into the Vision Pro mixed reality headset.