#481

Let the iOS app workflow finish on GitHub's macOS runner

OpenJosssphZhouwants to merge intofrom

What this changes

ios-app.yml could not finish on GitHub's macOS runner (macos-26-arm64, Xcode 26.6, iOS 26.5 simulator). These are the causes found over the runs on this branch, and what changes for each.

App job time:

  • The alive check counted 60 loops of launchctl list over simctl spawn, about 12 s each on the runner, so it took 12 minutes. It is now timed by the clock (60 s).
  • The iPhone simulator is shut down while the iPad screens are taken (with both up, each iPad screen took 4 minutes) and booted again for the unit tests.
  • The limits follow the measured steps: PokiCore 25 minutes (14 on the runner), simulator smoke test 60 (34), app unit tests 30 (23 with their build), app job 160 (113).

In-process and agent chat checks:

  • The check app waits up to 60 s for the fixture to be in front before it reads. In the last run the fixture took 6 to 22 s; before, the iPad check read the check app itself.
  • check.sh waits up to 180 s for the result.
  • A prepare that ends in session_timeout is asked again up to four times, in the check app and in the in-process probe's chat cycle, as Poki does when a call finds the open still going.
  • Each in-process check runs even when one before it failed, so one run shows every failure.

PokiCore:

  • AccessibilityServerMissingTests gives its call 20 s, so the reopen after kAXErrorServerNotFound keeps its margin on a slow runner.

App unit tests:

  • The step runs native/ios-app/scripts/app-tests.sh (the tests injected into Poki, location granted) instead of xcodebuild test. Under xcodebuild test, location was not granted, in-process reads were refused ("Not authorized for performing UI testing actions"), and the first web_open in BrowserGuardTests did not return for 19 minutes. With the script, all 291 tests ran in ten minutes and that test passed in 22 s.
  • app-tests.sh takes a time limit, a log path and a screenshot folder from the environment (POKI_APP_TESTS_SECONDS, POKI_APP_TESTS_LOG, POKI_APP_TESTS_SHOTS) and uses perl's alarm where GNU timeout is missing. CI keeps the log and a screenshot from each minute in the app-build-log artifact.

Still failing

The app unit tests step fails: 273 passed, 3 skipped, 15 failed. Every test that needs a Live Activity, an active Poki or an accessibility read of Poki fails from about the first test that turns a session on. A system permission prompt over Poki fits; the screenshots in the next run will show it. Commit 2f10b6e9 in #393 keeps those prompts away under XCTest, and PokiTests passed on CI with it on 2026-11-15 (228 tests). The same commit stops prepareForTask() from turning a session on, which testWikipediaTaskKeepsPhoneAutomationOff expects. LaunchWatchdogTests measured 1.59 s of startup work on the main thread on the runner, against a 0.25 s budget.

How you tested it

  • actionlint 1.7.7 on the workflow, bash -n on app-tests.sh.

  • The workflow dispatched on this branch, on GitHub's macOS runners (iOS Simulator): 44284452213, 44311694586, 44317011671 and 44380789728. In 44380789728 the in-process and agent chat jobs passed, and the app job passed PokiCore, both builds and the smoke test before the unit tests failed as above.

  • Locally: swift test --filter AccessibilityServerMissingTests in native/ios/PokiCore passes, and main.m compiles with check.sh's flags.

  • I removed passcodes, tokens, and private screen contents from this PR.

  • I release this contribution under the AGPL-3.0-only license.

🤖 Generated with Claude Code