A developer has released a free, open-source iPhone shortcut that lets the Grok bot see what is currently displayed on a user's phone screen when the Action Button is held down.
iOS Shortcut · Open source · Action Button
A free shortcut lets Grok see what is on your phone screen
Hold the Action Button and ask Grok about the video, article, or content currently displayed, with no copying or retyping. The convenience is clear; how the screen data is captured, sent, and stored is the open question.
How it works
STEP 1
Hold the Action Button
→
STEP 2
Shortcut reads the visible screen
→
STEP 3
Grok answers about that content
→
STEP 4
Build something from what you saw
Example: turn a short-form video you came across into a working project, without retyping its details.
What it offers
Ask about a video or article you are viewing, in place.
No copying, pasting, or retyping of context.
Runs inside Apple's built-in automation app, so no separate app install.
Free and open source, so the code can be reviewed.
Open questions
What screen data is captured, and how much of it.
Where that data is sent.
How long it is stored.
Behavior depends on configuration and ongoing maintenance.
The takeaway
Screen-aware assistants trade convenience for data exposure, and the details matter.
Capture
What appears on screen is what gets read.
Transmit
Destination is not detailed in the original release.
Store
Retention is not specified; review the code before use.
Continue reading The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in ✓ Signed in — this article isn’t included in your current plan.Unlocking the full article...