#529

Handoff: what's in 0.4.6 and what's next

OpenJosssphZhouopened 2d ago

@ZhehanZhang here's where things stand after tonight, so you can see what's shipped and what's still open. We paused for the night and plan to ship 0.4.6 tomorrow.

1. Merged to main, shipping in 0.4.6

0.4.6 is not tagged yet. Everything below is on main now and will be in it:

  • Voice can look at the screen and open apps by name (#498)
  • Talk to Poki from the Action Button (#477)
  • Screen History (#435, #437) and revoking in-flight queries when privacy settings change (#446)
  • 12306 result cards (#486), including a card for a single train (#521)
  • Live Activity / Dynamic Island (#496), with the expanded island's End button and bear kept inside the safe area (#508)
  • Signing & Updates page (#483), and "Sign In Again" when Apple's sign-in has expired (#500)
  • Opening apps by name (#331)
  • Custom endpoints (#458)
  • Foldable / iPhone Duo screen handling (#474, #76)
  • Cellular connections (#512, #478)
  • Keyboard fixes (#501)
  • Archiving conversations (#468)
  • NetEase Cloud Music and mini programs (#449, #448)
  • Clipboard (#459), #460, #453, #461, #457, #452
  • Poki Setup in Simplified Chinese (#507), and the Windows driver card plus mounting the disk image during install (#509)
  • Memory page grouped by app, with sources, edit and delete (#505)
  • Personal assistant prompt and context (#479)
  • One-call multi-step paths, launching apps by name, and reading the screen once it settles (#490)
  • New cold-launch screen (#520)
  • README with real-device screenshots and recordings (#515, #517, #526)

2. Picking up tomorrow

Found in tonight's real-device test. These block 0.4.6:

  • Cold launch shows a blank screen first. The system launch screen is a plain color, and the designed launch screen from #520 only draws once the app is running. The static launch screen should match its first frame.
  • Memory page files skills under the wrong app. Xiaohongshu and 12306 skills show up under WeChat. A skill seems to be filed under the first app opened in the conversation instead of the app it actually works in. Existing data needs to be regrouped on upgrade.
  • Voice: possible double handling of the input transcript. The realtime model already hears the audio. We're checking whether the transcript (gpt-4o-mini-transcribe, with no language set) also flows back as a user message somewhere, so one sentence gets handled twice.

Open PRs we're finishing:

  • #518: routines renamed to skills, each skill belonging to one app. Re-review passed; one contract test left.
  • #527: Apple account row squeezed on the Signing page. In review.
  • #524: bear blink speed, eye drift and lighting. Review passed.
  • #513: voice ready cue, and Retry from the Dynamic Island. Review passed; needs a real-device check.
  • #504: voice rework for Chinese recognition, replies drifting into English, and scroll/back. Being compared sentence by sentence against 0.4.5 before it goes back on a device. Not in 0.4.6.

Still to do:

  • "Automation Running" watermark stays after stopping a task. We couldn't reproduce it from the in-app Stop path in the Simulator, so we need device logs.
  • Screen History: a time-limited grant for agent queries after the owner unlocks.

External PRs waiting on review: #416, #249, #322, #462, #61, #376, #172.

If you want to take any of the "picking up tomorrow" items, just reply here with which one so we don't both work on it.

Activity

1
Dreaminmaster2d ago

Taking the Screen History time-limited agent grant follow-up, per the invitation in #446. The coordination draft is #533: separate UI/background authorization, provisional five-minute continuous-clock expiry, explicit revocation and regression tests. No request to merge until iOS verification and policy coordination are complete; keeping the other Screen History follow-ups separate.