Show HN: Omi – watches your screen, hears conversations, tells you what to do
Posted by kodjima33 2 days ago
Spent 4 months and built Omi for Desktop, your life architect: It sees your screen, hears your conversations and will advise you on what to do next
Basically Cluely + Rewind + Granola + Wisprflow + ChatGPT + Claude in one app
I talk to claude/chatgpt 24/7 but I find it frustrating that i have to capture/send screenshots of my screen and that it doesn't help proactively during my work
Whenever omi sees something wrong about my workflow, it will send me a proactive notification with advice. It will also point to something I'm missing.
The hardest part was to nail proactivity - after trying 20+ similar tools I didn't find a single one with smart proactive notifications based on content on your screen. I made it look at your screen every second with 4 main prompts:
1. Is the user productive or distracted?
2. Is there anything useful to say right now?
3. is there any task to add to do later?
4. is there anything important to remember about the user?
Full stack: - Swift - Rust backend - Deepgram transcription - Claude code for messaging - GPT 5.4 summaries - Gemini for embeddings and translation
Open source, stores screenshots locally, uses Claude Code for chat. Has cloud to sync with hardware or mobile app but can be disabled in settings
Comments
Comment by rl3 1 day ago
Pomodoro and todo list apps are so yesterday. Now I can have my graphics card observe me as an ever-vigilant guardian of productivity.
That might sound sarcastic, but moving context between prompts and just keeping the gears turning often isn't really that cognitively engaging these days. Thus, attention suffers.
So, that's actually pretty useful.
sudo humanctl status
Comment by hahooh 1 day ago
Comment by naomi_lgbt 1 day ago
What motivated you to build this? What did you learn? What is your favourite part?
Comment by smartypant 1 day ago
Comment by _aavaa_ 19 hours ago
Comment by jusasiiv 1 day ago
Comment by smartypant 1 day ago
Comment by nprateem 1 day ago
Seriously why would you think AI could read my mind and tell me what to do next without knowing my goals?
This sounds like the irritating tangential follow-on questions they ask on steroids. Generally irrelevant and take the conversation in a direction you don't want to go.
Comment by bakaev 2 days ago
Comment by Biologist123 1 day ago
Comment by apolloagent 3 hours ago
Comment by apolloagent 16 hours ago
Comment by apolloagent 1 day ago
Comment by apolloagent 1 day ago
Comment by rojan69 1 day ago
Comment by typeshitnigg 2 days ago
Comment by kodjima33 2 days ago
I'd rather listen to an AI for small things and use my brain on smth big and creative that AI cannot think about
Comment by legendnitro 2 days ago