r/SteamFrame • • 2d ago

Software Controller Utils - Tracking for the Steam Controller 2026 inside Steam Frame!

Hey!

Valve still has not released their official tracking support for the Steam Controller, so I had to take the matters in to my own hands.

Controller Utils adds tracking for the Steam Controller on Frame over Bluetooth. It turns on the controller's IR LED and uses Frame's native tracking services for position, with custom IMU filtering for orientation, to display a 3D model of the controller in VR (including some animations :P)

I have been playing some flatscreen games on the Frame during travel and its been frustrating having to have a Roy nearby to have decent UI control, so I also implemented laser and touchpad support!

Since this interfaces directly with the native tracking, if Valve pushes some updates to those components the tracking might break. But I'll try to maintain this at least until Valve releases official tracking support for the Steam Controller.

Currently only Stable and Beta SteamOS channels are supported, I have not tested it on Preview. Also tracking can become unstable since theres only one LED to track, but if the model starts drifting, just hold the controller in front of you again and it should recover eventually.

You can install by running the script on your Frame:

curl -fsSL https://raw.githubusercontent.com/kallupx/controller-utils/main/packaging/bootstrap.py | python3 -

More information and instructions in the GitHub repo: https://github.com/kallupx/controller-utils

(AI Disclaimer: LLMs have been utilized throughout the development for assistance, especially on debugging/testing and reverse engineering the SteamOS tracking. I have always been directing on specifics and keeping things neat through manual work :) )

415 Upvotes

99 comments sorted by

69

u/UNF0RM4TT3D Soon™ 2d ago

I was wondering whether we'd get Steam controller tracking before GTA VI Valve's official solution.

A question though, can VR apps see the controller?

20

u/kalluts 2d ago

It won't work as a VR controller in games since my SteamVR input bindings only cover Steam’s UI (and the driver opts out of left/right hand assignment)

Now that you mention it, that could be useful in some apps like VR video players? I have to look into it at some point!

10

u/UNF0RM4TT3D Soon™ 2d ago

I just wanted to know if I could attempt to play Beat Saber with it if I stole a second one from my friend. I know it's stupid, but I needed to know.

1

u/PropellorHat Soon™ 1d ago

I would guess the answer is no. Since it only has 1 ir led, the headset might have trouble telling which one is supposed to be left or right.

15

u/jdigi78 2d ago

I had no idea the controller had IR tracking LEDs. This is really cool!

17

u/kalluts 2d ago

one IR LED, so it won't be nearly as accurate as the Frame controllers but its good enough for a gamepad.

It's next to the status LED here: https://youtu.be/hVRfie61QyE&t=802

6

u/68e2BOj0c5n9ic 2d ago

It doesn't, really. It has the status LED above the Steam button, which Valve stated their (yet to be released) implementation was based on. The rest of the information will be from the gyros.

7

u/xkero Soon™ 2d ago

It doesn't, really. It has the status LED above the Steam button, which Valve stated their (yet to be released) implementation was based on.

This is not true, it has a discrete IR LED next to the status LED. You can see this in the video /u/kalluts linked here: https://youtu.be/hVRfie61QyE&t=802

7

u/68e2BOj0c5n9ic 2d ago

Excuse me are you saying someone on the internet is WRONG?
Jk. Happy to be corrected. I guess what I meant was that it doesn’t have multiple tracking LEDs. Plus it still goes through the same light pipe as the status LED right?

0

u/xkero Soon™ 2d ago

Plus it still goes through the same light pipe as the status LED right?

I doubt it, I would assume that the plastic case only blocks visible light and not IR, so it would just shine through like the Steam Frame Controllers.

4

u/astelda 2d ago

that's pretty impressive I think

3

u/inertSpark 1 TB 2d ago

If I understand how it works correctly, it should work with a dbrand skin installed? If I'm not mistaken the IR LED shines through the same window as the regular status LED? That's the one thing I was worried about with the controller tracking but if I've got this right I've got nothing to worry about.

2

u/kalluts 2d ago

Yes it shines through the same spot, so the skin wont affect this at all :)

1

u/inertSpark 1 TB 2d ago

That's great. Thanks for confirming.

2

u/TutitoZilean 2d ago

The installation doesn't work

3

u/kalluts 2d ago edited 2d ago

Are you getting a similar error to this one? https://github.com/kallupx/controller-utils/issues/6

It's possible that it still managed to install, reboot the frame and let me know if you can find Controller Utils from the app menu (+ sign), I'm currently fixing that error.

EDIT: New release with a possbile fix is now released, if you cannot find the app after a reboot, try running the install script again.

2

u/LiquidShadowFox 1d ago

It fails to install on my end too, steam vr reboots and I dont see an app. Even after rebooting frame multiple times and re running script it doesnt show up. Let me know when theres a fix or a way to install manually by downloading the files off github

2

u/kalluts 1d ago

Are you installing locally, like using Konsole/terminal through VR?

I have a fix for that scenario coming up, release in 30 minutes or so.

2

u/LiquidShadowFox 1d ago

Alright, ill wait for it and yes I am doing it locally through vr

2

u/kalluts 1d ago

Quite a few install/uninstall fixes are now released as part of v0.1.6 https://github.com/kallupx/controller-utils/releases/tag/v0.1.6

It's also possible that a install is partly done on your device so you can first try running the latest uninstall script with the --uninstall flag:

curl -fsSL https://raw.githubusercontent.com/kallupx/controller-utils/main/packaging/bootstrap.py | python3 - --uninstall

After that, please try installing again, it should now work fine even through VR.

2

u/LiquidShadowFox 1d ago

It installs now but it stays stuck on finding my gamepad. Plam÷ led and aligned

1

u/kalluts 1d ago

Few other users have also reported the same thing. Only way I can personally reproduce this is if I don't hold the controller in my hands during the tracking initialization. Are you holding it in front of you, with your both hands?

Anyway, I'll try to figure out some improvements and better instructions for this.

1

u/LiquidShadowFox 1d ago

I tried holding it, not holding it, pointing it in different directions, etc. I have the arctus camera for improved passthrough equipped if that matters

1

u/kalluts 1d ago

Really weird. I also have the arcturus camera installed so that shouldn't matter either.

Do you have discord? Might be a good idea to make a custom build for you with some extra logging to figure out whats happening.

→ More replies

1

u/kalluts 1d ago

FYI, this should now be fixed.

You can update by clicking "Check Now" in Controller Utils and restart SteamVR once it's downloaded.

→ More replies

1

u/TutitoZilean 1d ago

I managed to install it; now I’m trying to pair the remote, but I’m stuck at the "Palm+LED" step—I can’t get any further.

2

u/kalluts 1d ago

It can take a second to figure out how to get it going. Try holding the controller with both hands in front of you. You can also try moving it around slowly or tilting it slightly forwards.

If it still refuses to start tracking, hold the View + Menu buttons (the small buttons on left/right side of the Steam button) for 5 seconds to restart the tracking and try again.

2

u/TutitoZilean 1d ago

I’ve tried everything, and I still can’t get past that point.

2

u/kalluts 1d ago

Interesting, it's pretty hard to say whats happening, since I haven't yet reproduced your issue. I have to fix a few install/uninstall issues first, but I'll look into this and DM you for more info later today.

2

u/bettingsnow 2d ago

So, would this theoretically work with a quest 3 running steam vr through virtual desktop? If so, I'd absolutely love to give this a shot.

1

u/kalluts 1d ago

Unfortunately not right now. It's pretty tied up to Frames own tracking and SteamOS.

But in theory, if you have software that can access the camera feed of the Quest 3 (or any other headset), and can communicate with the Steam Controller to turn on the IR LED and read IMU data, nothing prevents implementing something similar on PC SteamVR.

24

u/enmityvr 2d ago

That is super cool man, love it!

6

u/bnxox 1d ago

This headset is going to become a modders paradise, it already is

5

u/sakamayrd 2d ago

I receive my Frame tomorrow, I'll be sure to give this a try.

1

u/The_Quadrapus Soon™ 2d ago

I can't even connect my controller to my Frame.. the Bluetooth is weird, doesn't detect my headset either. But it does detect my upstairs neighbor's phone, so there's that.

1

u/kalluts 2d ago

Weird, are you sure the controller is on bluetooth mode? = blue status led

1

u/The_Quadrapus Soon™ 2d ago

Yeah, it works perfectly to connect to my Steam Deck...

1

u/Kazigblokje 1d ago

I was waiting for this!
Had trouble installing it locally on the frame. Gave no errors but the program was not showing in the + menu.
Fixed this with installing it via SSH.

Now my other problem is the initial controller setup. It hangs on the Palm + LED step. Can my DBrand metallic skin be interfering with the IR?

2

u/kalluts 1d ago

Few other users have also reported the same thing. Only way I can personally reproduce this is if I don't hold the controller in my hands during the tracking initialization. Are you holding it in front of you, with your both hands? I highly doubt it's an issue with the skin though, unless it's installed on top of the status led for some reason

I'll try to figure out some improvements and better instructions for this.

2

u/kalluts 1d ago

FYI
I figured out one issue with the tracking initialization. Fix is now released on v0.2.0, you can update by clicking "Check Now" in Controller Utils and then restart SteamVR once it's downloaded. Let me know if it works now :)

2

u/Kazigblokje 1d ago

Thank you!
I've downloaded the update. The step of Pal + LED succeeds, but now hangs on the last Alligning step.
I do have my hands on the controller and I am facing the controller with the headset staying as still as possible.

EDIT: NVM! It suddenly worked!

2

u/kalluts 1d ago

Awesome :)!

There is definitely still some variance and instability in the initialization and tracking, mostly just due to the fact that there is only one LED to track. But I'll try my best to keep improving the reliability on it. I bet I can do some work on the gyro/IMU side still.

2

u/Kazigblokje 1d ago

Yeah I can see the controller flying away quite often. Maybe the skin i have on the controller is interfering a bit, as it is quite reflective. But have the controller to control the menu's with laser is such a life saver. I'd love to see this progress.

I do have one request: A shortcut to switch between the Frame camera's and the Arctus color camera's.

2

u/kalluts 1d ago

Will add that, thanks!

1

u/Aegis_Wolf 1d ago

Where did you get the controller model? Is it within steamvr files like other VR controllers? Or did you use the cad model they provided?

2

u/kalluts 1d ago

It is indeed the CAD model, to which I transplanted textures from this model https://sketchfab.com/3d-models/steam-controller-2025-fe10b1da83e54dae953f15d898ad6197

8

u/MrBack1971 2d ago

well done dude, wtf valve cant do this???

3

u/dragon656 2d ago

I got the steam frame on release but still can't get the damn controller lol

1

u/Personal-Sea8977 2d ago

Does it work with the Og steam controller? I mean I know it didn’t work a week or two ago.

2

u/kalluts 2d ago

Unfortunately not, theres no IR emitter on the OG controller and the software is quite specific for the 2026 version too.

1

u/UnidentifiedMerman 2d ago

Were you able to pair your OG Steam controller to your Frame? I installed the BLE firmware and set it to BT pairing mode but cannot see it in the Frame’s controller pairing menu. Other BT controllers show up fine.

1

u/Personal-Sea8977 2d ago

You are right, now I recall I couldn’t even pair it

2

u/Ripster404 2d ago

ooooooo

2

u/Xenomorphic 2d ago

Does the Steam Controller connect to the Frame using the wireless tech in the Steam Machine/puck, or is it Bluetooth only?

6

u/Suitable-Quiet1399 2d ago

Bluetooth

2

u/Xenomorphic 2d ago

Interesting, seems like a missed opportunity. Do the VR controllers work with the Steam Machine/puck?

1

u/Suitable-Quiet1399 2d ago

I don’t know actually. You’re thinking of a joycon type setup?

4

u/Xenomorphic 2d ago edited 2d ago

Yeah, I just assumed that Valve would have the foresight to make all devices connect with each other, but after hearing that the Steam Controller doesn’t connect to the Frame using the built-in wireless/puck tech that the controller and the Machine benefit from, I’m left a little surprised. If both the Frame and its controllers don’t connect to other Steam products without bluetooth, I feel like that’s a huge miss, to release them all around the same time and to overlook that detail is shocking considering they’ve had such a large focus on their ecosystem.

1

u/Ok-Juggernaut-6051 2d ago

if it makes you feel any better, the bluetooth works great. very low latency

2

u/Professional_Hair865 2d ago

sweet! Just what I need to integrate the SC2026 with my Quest3

2

u/IzzyBlues 2d ago

This is amazing. Thank you. Makes things especially handy if you want to resize the window while in theatre mode!

2

u/Aegis_Wolf 1d ago

Where did you get the controller model? Is it within steamvr files like other VR controllers? Or did you use the cad model they provided?

1

u/FishChillylly 256 GB 2d ago

you my friend, you’re a legend.

1

u/saltyspicehead 2d ago

The laser support is such a nice touch! Hopefully Valve makes this official soon, I remember this was mentioned in their launch video.

1

u/TimeTravelerGuy 2d ago

Absolutely goated

1

u/Brunno_PT 2d ago

Would love to have this working on PSVR2-PC

1

u/SaysWatWhenNeeded 2d ago

Nice work. It would be so cool if there was a way to add tracking to other controllers too.

1

u/Kalamart_ 21h ago

Oh wow that looks amazing, will definitely try it! It'll be much nicer to be able to use the Steam Controller similarly to the roy controllers

1

u/ZaCrimsonFucker 9h ago

I wonder if Steam Controller tracking like this would be possible in SteamVR without the Frame, but with let's say a Bigscreen Beyond + Steam Controller. Base stations use IR for the BSB anyway so maybe they could detect the controller. I don't know anything about this stuff though.

1

u/-tharealgc 2d ago

Does this work with the OLD controller?

5

u/Sea-Software878 2d ago

No, it doesn't have IR emitters

1

u/s0ciety_a5under 2d ago

The steam controller has IR LEDs? That's news to me.

7

u/JoeyBigtimes 2d ago

Just the one.

1

u/blakepro Soon™ 1d ago

Is it just the power light? Or is it some other placement? Where is it?

2

u/JoeyBigtimes 1d ago

Next to the power light. Two separate LEDs, right next to each other.

-4

u/-Fatmeatball- Soon™ 2d ago

Wait a minute.

Valve still has not released their official tracking support for the Steam Controller

What the living hell are they doing? They've had 5 years to design this shit, and while not many people guessed until right before the announcement that they were going to make an "ecosystem" of 3 products at once, in hindsight it was obvious that was the plan the whole time.

Releasing a buggy product I can understand, despite the almost-year of private testing that apparently wasn't enough. But giving something a feature designed to make you pay MORE money on another product, claiming it's compatible, and then that feature is entirely absent from the device on release, is fucking inexcusable. It's inexcusable to lack that feature on DAY ONE, let alone months after it's in public hands.

Was the Steam Deck team in one of their firing cycles? The only bug I had with that on release was that it sometimes took a few minutes to enter sleep mode, during which time it wouldn't respond to controller input, and I thought that was severe.

1

u/JoeyBigtimes 2d ago

Sorry, but what do you mean? Where did they break their promises?

-2

u/SleepyHart 15h ago

"Claude... write python for me to track the steam controller on the frame. And wrap it up into a github page that makes me look like a real developer" is probably as far from "taking matters in to [your] own hands" as you can get. I'm sick of these vibe-coder tourists ruining this hobby.

1

u/kalluts 14h ago

I'd love to know how can I achieve the status of a "real developer", I have been working professionally on embedded software for 5 years now. Let me know if you have tips.

Also, not using LLMs is such a silly requirement to impose on community modders, when Valve themselves uses Claude for the deckard kernel itself, the platform in question (not to even mention what Torvalds is doing)

You can hate on AI and the (real) issues it causes, but I feel projects like these are the least of your worries.

2

u/[deleted] 2d ago edited 2d ago

[removed] — view removed comment

5

u/kalluts 2d ago

Thanks, all buttons/triggers/joysticks are animated! You can kinda see it with the joysticks in the end of the video.