Apple AI is here and it's EPIC - ChatGPT added to Siri
Apple has finally introduced ton of new AI updates coming to iPhone, iPad and Mac. These include a brand new AI model called Apple intelligence as well as ChatGPT integration across all Apple devices.
Here is the full breakdown.
1. Apple Intelligence - New AI from Apple
Language and Text Creation:
Creates language and text using large language models.
Powered by brand new writing tools.
Ability to rewrite and summarize text within Mail, Pages, and third-party apps.
Image Creation:
Capable of creating images.
Personalizes images using access to your photo library.
Supports sketching, illustration, and animation.
2. Actions:
Cross-App Actions:
Take actions across your apps.
Example: Pull up files shared with you.
Example: Play the podcast your wife sent the other day.
3. Personal Context:
Contextual Retrieval:
Retrieves and analyzes context from your different apps.
4. Privacy:
On-Device Intelligence:
Utilizes on-device intelligence.
Employs private cloud compute.
Models run on Apple Silicon servers designed for this purpose.
Tries to process on-device first; if more compute is needed, it sends to the private cloud compute.
5. Siri:
5.1. Enhanced Natural Interaction:
More natural, relevant, and personal.
Offers Type to Siri functionality.
Allows switching between text and voice.
5.2. On-Screen Awareness:
Siri can see what's on your screen and use the content as needed.
5.3. Siri Actions:
Example: "Show me my photos and make them pop."
Example: "Add this to my note with bio."
6. App Intents:
6.1. New Framework:
Apps can define a set of actions for Siri and Apple Intelligence to take advantage of.
6.2. Siri Updates:
Updates coming to Mac and iPad.
7. System-Wide Writing Tools:
Capabilities:
Rewrite text.
Proofread documents.
Change tone of writing.
Summarize content.
8. Email Features:
8.1. Smart Reply:
Offers smart replies in Mail.
8.2. Email Summarization:
Provides email summaries at the top of your inbox.
Allows tapping to get a summary of long emails.
Prioritizes emails based on their context.
8.3. Notification Management:
Prioritizes notifications and offers summaries.
Reduces interruptions by surfacing only essential notifications.
9. AI in Messages:
Genmoji:
Create AI-generated emojis (Genmoji) based on descriptions.
Create Genmoji that resemble people in your contacts using your photo library.
10. Image Playground:
10.1. On-Device Image Creation:
Create as many images as you want on-device.
Integration within Pages, Keynote, and Numbers.
10.2. Image Playground App:
Dedicated app for creating images.
10.3. Image Playground API:
API available for developers.
11. Image Wand in Notes App:
Sketch to images:
Turns sketches into images.
12. Photo Editing Updates:
12.1. Clean-Up Tool:
Tools to improve your images.
12.2. Natural Language Search:
Search for photos and videos using natural language.
12.3. Memory Movies:
Create movies based on your photos and videos using prompts.
13. Notes App Enhancements:
Audio Features:
Record and transcribe audio.
Provides summaries of recordings.
14. ChatGPT Integrations:
14.1. Siri Integration:
ChatGPT integrated into Siri.
14.2. Content Creation:
Create content with ChatGPT in Pages using the compose feature.
14.3. Access and Features:
Free access to ChatGPT.
Paid subscribers have access to additional features on Mac.
15. Availability:
Available this summer.
Public beta coming in iOS 18 this fall.
Access Top Courses on ChatGPT and 50+ AI Tools on Our E-Learning Platform: https://bit.ly/skillleap