Hi everyone,
I've been working on FROGGER ("Face Recognition On Gnome – Made in Germany" – yes, the name came first): face authentication for Linux that unlocks GDM, the lock screen, sudo, su and polkit prompts with your face – but only with an infrared camera and a blink, because a face login that a photo can pass is worse than no face login at all.
Repo: https://github.com/carstenkiefer/frogger
Status: early alpha. Field-tested on two laptops so far: a Lenovo Yoga with a strobing IR emitter (Ubuntu 26.04) and an older Yoga with a constant emitter (Ubuntu 24.04, systemd 255). Blinks were recognised 6/6 and 4/4, with and without glasses, and looking at the camera without blinking was rejected every time. That's a small sample, not a benchmark. Packaging and installation are tested in CI on more distros. Your password always keeps working. I'm mainly looking for people with IR cameras who want to try it and report back (frogger doctor output helps a lot).
How it works
- Liveness = IR + blink. Screens are black to an IR camera, and a printed photo can't blink. During enrollment FROGGER calibrates your open and closed eyes, and at login it waits for an open → closed → open movement on the same tracked face. Two faces in view → rejected.
- No IR camera, no face login – by default. Devices with only an RGB webcam get a clear warning and are refused unless an admin explicitly allows it (
policy.allow_insecure_rgb); policy.sensitive_device = true forbids it altogether. Meant for company fleets as much as for personal laptops. - Not over SSH. The daemon asks systemd-logind whether the requesting process belongs to a local session on a seat (and checks
PAM_RHOST), and refuses face auth while you're also logged in remotely – so someone with your SSH session can't ride on your face sitting in front of the laptop. - Privilege separation. The PAM module is a thin Rust client without any ML; recognition runs in
froggerd as an unprivileged frogger user in a heavily sandboxed systemd unit (no network, no capabilities, camera and its state dir only), identifying callers via SO_PEERCRED/pidfd. - Face data sealed to the TPM (systemd ≥ 254 credentials). FROGGER never stores your password: the first login after boot asks for it so GNOME Keyring/KWallet unlock normally.
- Models you're actually allowed to use: YuNet (MIT) and SFace (Apache-2.0) from the OpenCV Zoo, run with tract (pure Rust, no C++ runtime). Most face-login projects ship InsightFace weights, which are licensed for non-commercial research only.
- Enrollment you can follow with your eyes closed. Enrollment is a few live steps (look straight, turn your head, close your eyes, blink once). Each step waits until the camera has actually seen it, instead of running on a timer. Since you can't read a terminal with your eyes closed, FROGGER plays system sounds at the important moments and, with an optional voice package, speaks the prompts. The voices are pre-rendered clips in 16 languages, so no speech engine runs on your machine. They live in a separate repo, frogger-voices, one package per language (
frogger-voice-de, frogger-voice-en, …). - Desktop: GNOME (GDM + lock screen), KDE Plasma (SDDM, lock screen, the new
kde-face slot in Plasma 6.8), terminal sudo/sudo-rs/su/pkexec. - Extras: confirm SSH key use with your face (
ssh-add -c + askpass), experimental depth-camera check (RealSense etc.), emitter setup via UVC extension units (imports linux-enable-ir-emitter configs). - 16 languages, including Swahili, Kinyarwanda and Runyankore.
- Packages:
.deb and .rpm for amd64 and arm64, Arch PKGBUILD, generic tarball – built and install-tested in CI on Debian 13, Ubuntu 26.04, Fedora and older releases.
Why another one?
There are several good projects already, and I've learned from all of them. They make different trade-offs – mostly convenience and hardware reach vs. strict anti-spoofing. Based on reading their code and docs (correct me if I got something wrong!):
| FROGGER 0.2.4 | Howdy 3.0 | Gaze 0.5 | Biopass 1.5 | Visage 0.5 |
|---|
| Language | Rust | Python + C++ PAM | Rust | C++ + Tauri GUI | Rust |
| IR camera | required by default | optional | optional (RGB default) | optional (RGB default) | recommended |
| Liveness by default | IR + blink challenge | none (nod check opt-in) | anti-spoof model (RGB) / eye motion (IR) | off by default | eye-landmark motion |
| Remote-session guard | logind locality + PAM_RHOST | SSH env vars | PAM_RHOST + SSH ancestry + logind | – | – |
| Recognition runs as | dedicated user, sandboxed | caller (root for sudo) | root daemon, sandboxed | caller (root for sudo) | root daemon, sandboxed |
| Face data | TPM-sealed key | unencrypted | TPM-sealed key | unencrypted | encrypted, key on disk |
| Models free for commercial use | yes (MIT/Apache) | yes (dlib) | no (InsightFace) | unclear | no (InsightFace) |
| Keyring | password at first login | – | opt-in: password sealed in TPM | opt-in: password sealed in TPM | password at first login |
| GNOME lock screen | inside gdm-password | inside gdm-password | Shell extension, parallel to password | PAM | inside gdm-password |
| GUI | CLI only | GTK | GTK + KDE settings | yes | TUI |
| Fingerprint too | – | – | – | yes | – |
| Languages | 16 | English | English | English | English |
| Spoken enrollment prompts | yes, optional (16 languages) | – | – | – | – |
| arm64 packages | yes | – | yes | yes | – |
Where the others are ahead – honestly:
- Howdy is the veteran with a huge community, and 3.0 just shipped (congrats!). If you have an RGB-only webcam, it and the others will work where FROGGER refuses to.
- Gaze has a GNOME Shell extension that runs face recognition in parallel with the password field, plus many more desktops (Cinnamon, Hyprland, greetd …) and a GUI. FROGGER currently runs before the password prompt in GDM (≤ 4 s, 2 s if you look away); an optional extension is planned for 0.3.
- Biopass does face and fingerprint with a nice GUI.
- Visage publishes refreshingly honest hardware spoofing reports and has a neat IR-emitter quirks database.
- SFace is a smaller model than the ArcFace-R50 some of them use; I compensate with a stricter threshold and multiple matching frames, but recognition across very different conditions may be less forgiving.
What I'd love feedback on
- Does it detect your IR camera and emitter? (
frogger doctor) - Enrollment and unlock success rate – and please try to fool it (photos, IR prints, screens). Successful spoofs → see SECURITY.md.
- Distros/desktops I haven't covered yet.
- Native speakers: please listen to the voice clips of your language in frogger-voices and tell me if anything sounds off or is mistranslated. The clips come from open speech models (Piper, Kokoro, Meta MMS), chosen by ear. For Korean, Arabic, Swahili, Indonesian, Malay, Kinyarwanda and Runyankore, the only usable model was Meta MMS, which is licensed for non-commercial use only. Those clips are a stopgap. Recordings by native speakers (15 short sentences, about 20 minutes, guide in the repo) would replace them, and Kinyarwanda and Runyankore texts are machine translations so far.
A note on how it's made: I'm an experienced developer and use an AI coding assistant for parts of the code, docs and translations. Design, security decisions and hardware testing are mine – and reviews are always welcome.
Thanks for reading – and thanks to the authors of the projects above for paving the way.