😺Google is killing the prompt box
The Neuron · Grant Harvey · 2026-05-13
Google announces Magic Pointer and Gemini Intelligence for Android at its 2026 event, introducing a context-aware cursor that understands what users point at and executes intent without requiring a full typed prompt.
Appears in
Extraction
Topics: ambient-intelligenceai-interaction-designgoogle-geminimultimodal-aiagentic-ai
Claims
- Google's Magic Pointer uses Gemini to interpret what a user is pointing at on screen and can act on vague references like 'this' or 'that' without requiring a full text prompt.
- Gemini Intelligence for Android can automate app tasks, summarize and compare web pages, fill forms, convert messy dictation to polished messages, and build custom widgets.
- Thinking Machines Lab previewed interaction models that process audio, video, and text in 200-millisecond chunks, enabling real-time listening, interruption, and tool use.
- Perceptron released Mk1, a model that understands video as a stream of events rather than a collection of discrete screenshots.
- The shift toward ambient intelligence may eventually reduce reliance on screens and keyboards as the primary interface to computing.
Key quotes
A normal cursor tells the computer where you clicked. Google wants the cursor to tell the computer what you mean.
The interface starts carrying part of the prompt for you.
The dream of 'ambient intelligence', or intelligence that is built into the background of our world to support us only when called upon (like 'magic') could finally become reality…