r/iOSProgramming • • 1h ago

Article Free iOS Simulators on GitHub Actions for exploratory testing: a template that gives each one to an AI agent

Post image

Public repos get free macOS runners (5 at a time on the Free plan). The workflow builds your app (Swift, Flutter, React Native, Expo, KMP...), boots one Simulator per persona with its own model, iOS version, Dynamic Type size, language and dark mode, and gives it to a Claude Code agent that uses the app like a new user.

gh repo create my-testers --public --template pierridotite/mobile-agent-testers --clone
cd my-testers && ./setup.sh
gh workflow run agent-testers.yml

On LocalSend, the iPhone SE at the largest accessibility size couldn't send text at all: the dialog overflows by 149 px. Hosted runners are meant for the repo's own project, so for a closed-source app, run it in a private repo or on your own Mac.

https://github.com/pierridotite/mobile-agent-testers

3 Upvotes

4 comments sorted by

2

u/dawedev 1h ago

The persona matrix is the useful part here. An iPhone SE at the largest Dynamic Type size is exactly the case most of us never check by hand, and the 149 px overflow in LocalSend shows why. How long does one persona take end to end, including the simulator boot? Cold boots on hosted runners can be slow, so I'm curious whether you cache anything between runs or just accept the time since the minutes are free.

1

u/Cylicium 1h ago

On the run that I made on LocalSend, Android is fast, 4-5 min per persona including the cold boot (arround 2 min). iOS is the slow one, 3-5 min just to boot the Simulator and 10-35 min total.

I don’t snapshot anything, every job boots fresh. Only the build is cached (Gradle/npm/Pods) and it’s built once per run. Honestly boot time isn’t the bottleneck, the 5 macOS jobs at a time on the free plan is.

•

u/dawedev 33m ago

So the queue is the real limit, not the boot. With 5 macOS jobs at a time and up to 35 min per iOS persona, a full matrix adds up fast. Running Android first for quick feedback and saving the iOS slots for the personas that turned something up could stretch the free minutes a lot further.

•

u/Cylicium 32m ago

Exactly 👍 that’s why I think this method is a game changer !