Google is adding "Magic Pointer," a feature that understands on-screen context, to the Gemini desktop app for Mac. Users can highlight or point at information in any window and ask Gemini by voice to edit, summarize, or create—rolled out as part of "Speak to Window."
Gemini Desktop · DeepMind AI Pointer
Google brings "Magic Pointer" and "Speak to Window" to Gemini on Mac
Gemini reads what's on your screen and acts on it — point or speak to draft, summarize, and create without ever copy-pasting. Built on the same AI Pointer that powers the new Googlebook laptop.
🎤 Speak to Window
Hold fn over any open window and tell Gemini by voice to draft emails, build documents, or make images. "Create with just your voice."
✦ Magic Pointer
Wiggle the cursor, highlight anything on screen, and Gemini reads it as context — to edit, summarize, or create.
Point → Act flow
Point at content
a date, a PDF, a restaurant in a video
→
Gemini reads context
visual + semantic understanding
→
Action done
calendar entry, email summary, booking
Where you can use it
Googlebook (Android-based · this fall 2026)
Full version
Gemini in Chrome (Mac / Windows)
Partial · AI Studio demo
macOS Gemini desktop app
Rolling out from summer 2026
Googlebook ships from Acer, ASUS, Dell, HP & Lenovo with Gemini built in at the OS level.
Anticipation
"The cursor's real evolution"
"A way to eliminate copy-paste"
"A laptop version of Circle to Search"
Concern
How much screen is sent the moment you shake the cursor?
Cloud or on-device processing — unclear
Is it used for training? Part of "AI everywhere"
Reinventing the cursor. The mouse pointer has been essentially unchanged since 1968 — Magic Pointer reimagines it for the AI era, with DeepMind's AI Pointer also slated to come to Chrome.
Continue reading The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in ✓ Signed in — this article isn’t included in your current plan.Unlocking the full article…