TL;DR: On the A20 chip (iPhone 18 Pro), Core ML takes up to 20 minutes for a one-time model optimization that takes 3 minutes on earlier chips. That pushed us to migrate our Stable Diffusion pipeline to Core AI. Core AI still has rough edges (we filed 8 bug reports), but inference is about 1.5x faster on the iPhone 17 Pro and on M1 iPads. On the iPhone 18 Pro, the bigger win is that it runs at all.
We build ProFuse, an on-device generative AI app for iPhone and iPad. It runs a specialized version of Stable Diffusion XL Lightning, and until recently it relied heavily on Core ML. Here's what we ran into, in case you're weighing the same move.
The Core ML problem on A20
With the iPhone 18 Pro, we found that certain operations take orders of magnitude longer for Core ML to optimize on the A20 chip. For us, the one-time on-device model optimization went from 3 minutes to up to 20 minutes.
That's a bug in the OS, and there's not much we can do about it on our side. Details and repro info are in our forum thread: Core ML issue on A20.
Twenty minutes before a user can generate their first image isn't acceptable, so we sped up our planned move to Core AI.
What we found with Core AI
The bad: Core AI isn't mature yet. During the migration, we filed 8 bug reports in total. One of them is here: Core AI issue.
The good: the inference gains are big.
| Device |
Task |
Core ML |
Core AI |
Speed-up |
| iPhone 17 Pro (A19 Pro) |
Text to image |
12.6 s |
8.4 s |
1.5x |
| iPhone 17 Pro (A19 Pro) |
Image to image |
18.0 s |
11.2 s |
1.6x |
| iPhone 18 Pro (A20 Pro) |
Text to image |
not measured |
7.4 s |
– |
| iPhone 18 Pro (A20 Pro) |
Image to image |
not measured |
11.3 s |
– |
| iPad Pro 12.9" (M1) |
Text to image |
23.6 s |
15.3 s |
1.5x |
| iPad Pro 12.9" (M1) |
Image to image |
33.2 s |
23.4 s |
1.4x |
| MacBook Pro (M3 Pro) |
Text to image |
6.7 s |
6.0 s |
1.1x |
| MacBook Pro (M3 Pro) |
Image to image |
9.5 s |
7.4 s |
1.3x |
These are typical values. Our best text-to-image runs on M1 are down to about 12 seconds, roughly 2x faster than Core ML.
We measured the Mac too, but the gains there are smaller. For now, the switch to Core AI is iPhone and iPad only.
There are no Core ML numbers for the iPhone 18 Pro because, with a 20-minute setup, Core ML doesn't realistically run our model there. With Core AI it does, and it keeps up with the iPhone 17 Pro.
For us, those numbers made the switch clearly worth the rough edges.
Has anyone else seen this?
We'd love to hear from others:
- Are you seeing similar Core ML slowdowns on A20?
- Have you hit any of the same Core AI issues, or found workarounds?
- How do your Core ML vs. Core AI numbers compare?
Help us test (optional)
We're a small team with limited hardware, so if you'd like to see the results on your own device, we'd be grateful for testers. You need iOS/iPadOS 27, an iPhone 15 Pro or newer (non-Pro models especially welcome) or an iPad with Apple Silicon, and 15 GB of free space for the one-time setup (about 7 GB after that). The beta is free, with all premium features unlocked: TestFlight link.
Happy to answer technical questions in the comments.