Home Assistant + OpenAI: AI Tasks with Object Recognition
Home Assistant + OpenAI: AI Tasks with Object Recognition
Want to see AI in action in Home Assistant?
In this video, I use OpenAI’s AI Tasks to analyse a fridge photo, send mobile notifications, and display the items directly in your dashboard. A full step-by-step guide you can follow along with.
#lazytechgeek #HomeAssistant #SmartHome #OpenAI
⏱️ Timestamps
*Setting up OpenAI*
00:00 Intro
01:33 Updating Home Assistant Core to 2025.8 or later
03:31 Where to find AI Suggestions
04:03 4 steps before enabling AI Suggestions
04:39 Step 1 – Log into the OpenAI portal
08:02 Create an API key
09:08 Verify organisation (UK-only step?)
12:02 Step 2 – Install the OpenAI integration
13:04 Step 3 – Add the OpenAI service (if not already added)
13:49 Configure OpenAI AI Task
14:31 Temperature & Top P explained
16:18 Important warning about Temperature & Top P settings
17:59 Code Interpreter overview
18:35 Reasoning Effort and Verbosity explained
19:25 Step 4 – Add AI Tasks
*Using AI Suggestions*
19:54 Demo: Automation using AI Suggest (failed attempt)
*Object recognition*
24:24 Using object recognition to list items (Step 1 – Upload camera image)
26:13 Create a fake camera using the uploaded image
27:39 Automation to notify with objects listed
31:39 Demo: Automation notifying with object list
*Cards – Input Text method*
32:18 Cards for listing fridge items (intro)
32:55 3 steps for creating the card
33:36 Step 1 – Create `input_text`
35:06 Step 2 – Update automation to write to `input_text`
36:03 Run automation to confirm `input_text` updates
37:04 Step 3 – Create card pulling data from `input_text`
*Cards – Markdown method*
40:13 Demo: Input Text card working
40:56 Switch to Markdown for listing items
41:36 Step 1 – Create `shell_command`
43:45 Step 2 – Create `command_line`
45:28 Update automation to write list to Markdown
46:29 Step 3 – Create card pulling data from Markdown
48:10 Demo: Markdown card working
51:39 Outro
🔗 Links & Resources:
GitHub (Automation, code, and images) saved here:
https://github.com/LazyTechGeek/HomeA...
How to install HACS in Home Assistant:
• How to Install HACS in Home Assistant (Ste...
OpenAI Platform:
https://platform.openai.com/
OpenAI Pricing
https://platform.openai.com/docs/pricing
OpenAI tokenizer
https://platform.openai.com/tokenizer
Temperature” and “Top_p” Parameters explained (community resources):
/ understanding-openais-temperature-and-top-...
https://community.openai.com/t/cheat-...
🎵 MUSIC USED IN THIS VIDEO
Intro Track: Powerful Action Rock Trailer
🎤 Artist: RocknStock
🎧 Source: Pixabay
🔗 https://pixabay.com/users/rocknstock-...
💬 Got questions or stuck on a step?
Leave a comment below or join the Lazy Tech Geek Discord for help!
🔗 / discord
👍 If this video helped, tap like and subscribe for more smart home guides.
🔔 Subscribe here: / @lazytechgeek
☕ Support the channel: https://buymeacoffee.com/lazytechgeek