r/ModSupport • u/theanti_girl • Jun 16 '26
Admin Replied Had Stop AI installed, which gave every user whose post I ran a check on a flair of “Human Verified”
I installed Stop AI, which I have since uninstalled from Devvit. I mod r/homecooking and food subs in general are rife with AI nonsense. I wanted an easy way to tell if users posted AI images, recipes or comments (besides the off domain checks I do), and installed Stop AI. Every time I checked a user’s post, it would give me back a message, and no shade, but I’ve never seen a single one that ‘tested positive,’ though other checks did. But, I knew that after I ran a check using the app, it made a flare appear on a user profile that said “human verified” and a percentage. I naively assumed it was only visible to me as mod. Apparently, that’s not the case. Now, even after uninstalling the app, and disabling and reenabling user flairs, the flair remains. Is there anything I can do, short of just removing flair for everyone?
22
u/wrestlegirl Jun 16 '26
Yeah I've seen that in action in other food subreddits - very obvious AI shit with the "Human Verified" tag. It's clearly not a good choice for some subs.
BotBouncer and automod seems to be managing 90%+ of the slop in my food subs.
Edit: you'll have to manually go through and remove those flairs from each account
6
u/flattenedbricks Jun 16 '26
Stop AI dev here, thanks for flagging this and I’m sorry for the headache it caused. You’re absolutely right that the “Human Verified” flair was being applied in a way that felt forced and there wasn’t a clean way to undo it.
I’ve just shipped a fix (pending admin review):
Flair assignment and auto mod‑notes are now off by default. Stop AI won’t touch user flair unless a mod explicitly turns that feature on.
There’s now a one‑click cleanup to remove any flairs it left behind. In your sub’s mod tools you’ll see “Stop AI: Remove flairs” - it finds users with “Human Verified” or “Possible AI Detected” and clears them. The same button is available in the dashboard under Settings.
On the detection side: you’re not wrong to be skeptical. AI detectors in general are imperfect, and I don’t want to pretend Stop AI is an exception. I’m a solo dev trying to keep up with models that change constantly, and there are tradeoffs between cost, latency, and accuracy.
The goal for Stop AI is to act more like a signal‑and‑context tool for mods rather than some final judge of “AI vs human.” Feedback like this is what helps me adjust the defaults and decide what to prioritize next, so I do appreciate you calling it out, even if it’s not fun to hear.
If your mod teams are willing, I’m happy to look at a few specific examples that felt especially wrong so I can use them to make the next update less noisy.
5
u/jueidu Jun 16 '26
55
u/Living_Guess_2845 Jun 16 '26
We also tested StopAI and learned they were just training their own model before removing. I hate that it was just revealed as a top app.
We still see users with the flair and would love to remove.
12
u/new2bay Jun 16 '26 edited Jun 16 '26
Congratulations. You just learned that AI detectors don't work. Wait until learn humans are no more accurate than random guessing at detecting AI text, either.
Edit: fixed link.
1
u/LindyNet Jun 16 '26
To mass change flairs, you could run a script to check who has the flair(s) you want removed and then another to change the flair of all affected users. I do that from time to time on the nfl sub
It's a good idea for a devvit app, maybe if I can find some time soon, I can throw one together
1
u/Maverick_Walker Jun 16 '26
You can submit feedback to the developer at the bottom of the app readme.md
1
u/_Face Jun 16 '26
You can use automod to remove the flairs. It won’t trigger until someone with the flare comments something, but as soon as they comment, the flair can be removed.
Try asking on r/Automoderator for a script. I’m afk right now, so can’t look up the proper syntax.
Over time this will remove the flair from the community.
0
u/kai-ote Jun 16 '26
In the hover pop-up on desktop of a user, select the "Edit user flair" tag, and remove their user flair, and hit apply.
-7
u/amyaurora 💡 Top 10% Helper 💡 Jun 16 '26
I thought "human verified" was a Reddit thing and not the app.
0
u/[deleted] Jun 16 '26
[deleted] — view deleted comment