- Android phones now read text that apps draw without describing it, as in mini-programs and other pages inside super-apps, games and maps: Pinky reads it from the screen on macOS and Windows, and agents can read and tap it.
phone_observetakesocr: trueto read all the text on the screen. - A blocked app you allow for a task is read this way too: agents get its text, never a picture of it.
- Taps on Android where the screen says little, such as a "Pay" button that is a picture, are now checked against the text drawn there.
- Pinky now reads text from screen pictures on Windows too.
中文
- 安卓手机现在也能读出 App 画在屏幕上、却没有提供无障碍信息的文字，比如超级 App 里的小程序和其他页面、游戏和地图：Pinky 在 macOS 和 Windows 上从屏幕画面里识别这些文字，智能体可以读到，也能点击。
phone_observe加上ocr: true可以读出屏幕上的全部文字。 - 你在任务中放行的被屏蔽应用也会这样读：智能体只拿到文字，拿不到它的任何画面。
- 在安卓上点击画面里文字很少的地方时，比如一张图片做成的“支付”按钮，Pinky 现在也会对照那里画出的文字来检查。
- Windows 上的 Pinky 现在也能从屏幕画面里识别文字。
macOS: brew install --cask diygod/tap/pinky, or the .dmg for your Mac below (arm64 for Apple silicon, amd64 for Intel).
Windows: pinky-setup-2026.1108.19-amd64.exe. Linux: pinky_2026.1108.19_amd64.deb, or pinky-2026.1108.19-linux-amd64.tar.gz.
Claude Desktop: with Pinky installed, open pinky-2026.1108.19.mcpb to add Pinky to Claude Desktop as an extension; Settings › Agents in Pinky connects Claude Code, Codex, Cursor and others with a click.