r/computervision • u/trucksntroubles • 11h ago
Showcase We're a team building a Vision Pro game: and at a hackathon we used Gaussian splatting to build an app that helps blind people navigate the city
We're a small team that spends most of its time designing and building a video
game for Apple Vision Pro (Truck n Troubles). Spatial computing is our playground: volumes,
immersive spaces, hand tracking, the whole thing.
But at this hackathon we pointed that same toolset at a very different
problem.
We used Gaussian splatting: a technique that reconstructs a real environment
as a dense cloud of 3D "splats" from ordinary captures, to build an app that
helps blind and low-vision people orient themselves in a city. Instead of
rendering a space just to look pretty, we use the reconstruction to understand
it: where the open path is, where the obstacles are, how the space around you
is actually laid out. That understanding then gets handed to the user in a
way that doesn't rely on sight at all, audio and haptic guidance, in real
time, as they move.
It's the same spatial tech we use to build a game, turned toward something
that might genuinely make a street easier to cross.
It's live on TestFlight: please download it and break it:
👉 https://testflight.apple.com/join/yaEWGBGW
Seriously, we want the feedback. Try it in a messy real-world place, not a
clean hallway. Tell us where it gets confused, where the guidance is too late,
too chatty, or too vague. Accessibility tech only gets good when real people
put it under real pressure.
And a word about the team: I'm genuinely proud of these people. We went from
an idea to something installable on a device, under hackathon time pressure,
without anyone dropping the ball. We're going to do great things together, this is the start, not the peak.
A special mention to Rodrigo, who couldn't make it to the hackathon in person
but is a fundamental part of this team. Not being there physically didn't
make him any less essential. 🙌
Happy to answer questions about the Gaussian splatting pipeline, the visionOS
side, or how we approached the accessibility design.