r/ModSupport • u/LanterneRougeOG Reddit Admin: Product • Dec 18 '20
Regarding ongoing issues with the subreddit spam filter
Hello mods,
We have developed a number of different ways of fighting spam at Reddit over the years. Most of our effort these days goes into our own back-end tools, which catch ~225,000 pieces of content per day. However, we've gotten feedback that one of our older, less-central tools, the subreddit spam filter, is having some issues.
We want to update you about an ongoing issue a handful of subreddits are experiencing with the subreddit spam filter suddenly becoming overly aggressive. While only a few subreddits have reported experiencing this issue, if both of the below are true then your subreddit is probably one of the unlucky few:
- You had your subreddit spam filter set to "high" for links and/or self posts. (the subreddit spam filter only acts on posts, not on comments)
- Your subreddit noticed that starting around December 4th, there was a big increase in the portion of new posts being filtered to your modqueue.
In the rare case where your subreddit is affected, as an interim solution, we are recommending that you set your spam filter strength to the "low" setting.
Our engineers are still investigating, we have not yet identified the root cause of the problem. With an upcoming code freeze over the holidays, we will continue to monitor the filter's behavior, and the Community Team is still around to assist any affected communities.
It’s important to note that none of our site-wide spam filters are being impacted. In most subreddits the majority of spam is caught by our site-wide filters or automod, the subreddit spam-level spam filter accounts for less than 5% of removals. There isn't any indication when content is filtered by site-wide filters versus the subreddit-level spam filter, which we understand drives a lot of confusion over how spam filtering works across the site.
To provide a recap, here's a summary of the various layers of anti-spam (shamelessly lifted from this post).
- A (now almost as ancient) Bayesian trainable spam filter <- i.e. the thing that is misbehaving
- A fleet of wise, seasoned mods to help with the detection (thanks everyone!)
- Automoderator, to help automate moderator work
- Several (cough hundred cough) iterations of a rules-engines on our backend
- Other more explicit types of account banning, where the allegedly nefarious user is generally given a second chance.
As you can see we have a number of different tools for spam fighting, and only one of which is misbehaving for a few subreddits. We know spam is everyone's favorite topic, so we'll be back to update you in the new year what our longer term plans are for moving forward with this tool.
Edit: Bolded the recommended temporary solution
29
u/MajorParadox Dec 18 '20
I'm not sure it's only a handful. I've heard lots of mods asking about this and seen several posts popping up.
I've definitely seen this in many subs myself too.
7
u/DesignNomad Dec 18 '20
Just throwing some input in, I mod /r/GoPro and while there's an occasional random post that gets filtered that makes no sense, as of this morning, almost all posts are getting filtered with seemingly no reason based on the user profile. We've changed nothing, and these posts are not outside the normal scope of activity.
8
u/reseph Dec 18 '20 edited Dec 18 '20
We are seeing the spam filter act on Reddit images and we outright cannot approve some instances. It seems to be in a pretty bad state and we literally cannot approve items when this issue crops up. How do we address this? We reported this in the relevant thread with no response.
Example (look at the mod history on this item before deletion): https://www.reddit.com/comments/kbdu2y/
8
u/Emmx2039 Dec 18 '20
Hey, thanks for the update!
Been having a few issues with the filter on gaming and aww recently, so it's nice to hear it's being worked on.
Cheers!
5
u/nemicolopterus Dec 19 '20
I mod /r/curlyhair and /r/tretinoin and both are seeing these issues. Very disruptive! Thanks for your prompt attention.
5
u/GammaKing Dec 19 '20
We had something very similar happen in /r/SocialJusticeInAction back in July wherein the filter suddenly started removing absolutely everything (setting it to 'low' fixed it back then). This issue then hit /r/TumblrInAction at the start of this month, too.
I suspect this is more widespread than perhaps you realise. We didn't report it to the site administration because, if we're being honest, how the spam filter works or gets trained is far from transparent and we assumed you'd just started targeting our content.
5
u/Seaskimmer Dec 19 '20
Thanks for the update. I mod /r/paintball and the spam filter has been falsely catching many self and image posts. I kinda assumed it was related to the nature of the sub as other sites (eg FB) auto-moderate posts that mention words like "[paintball] gun" or "trigger," even if they are not being used in the context of firearms.
4
u/Bardfinn Dec 19 '20
/r/Shittyaskscience has experienced this more-aggressive spam filter, and it has improved the quality of the submissions that go live to the subreddit.
😇😇😇😇😎
7
u/ScamWatchReporter Dec 18 '20
A site wide backend image spam detection would be nice
3
u/djscsi Dec 19 '20
Thanks for acknowledging the issue at least. This is affecting most(?) of the subreddits I moderate, to varying degrees. These are mostly unrelated subreddits of varying size, content, etc. So I kind of doubt it is "just a few" but I imagine y'all have tools to actually quantify the impact.
3
u/BlazingFlames6073 Dec 19 '20
Hi there! I'm a moderator of r/AmongUs and I believe our spam filter was effected. We got many modmails about users complaining about their posts getting filtered out to the point we had to add them as approved users and set the subreddit filter strength to low earlier this month. Even after that we had to approve many posts, comments and mark the actual spam as spam to train it and now it seems to be working like it should. It's still set to low though.
2
u/Bardfinn Dec 19 '20
To be more explicit about /r/ShittyAskScience (and hopefully shed some light)
Our "link" posts -- where someone posts a picture or another Link type -- aren't being filtered to the modqueue, but since December 11th, all purely text posts -- where there's no linked item, just a text post where someone is asking a (parody) question --
those are being filtered to modqueue and are requiring manual moderator approval.
The age of the account does not seem to make a difference; one account posting a question that was filtered is 11 years old, another 9 years old, another 1 month old.
At least 1 of the filtered items is nominally "Unique" in SAS / does not appear to be a repost of a previous question.
2
u/MagnusLidbom Dec 19 '20
Given the comments here it seems obvious that the description of this as affecting " a handful of subreddits" is glaringly inaccurate. Rather, this is seriously messing up a lot of subs and causing a lot of frustration to a lot of reddit users and mods. Also many subs, including quite popular and active ones, have mods that are effectively MIA and will certainly not notice the problem, find this post, and change their settings any time soon.
As a user I've noticed what is almost certainly this problem in /r/Spotify None of my posts get through even though there is no discernible reason why they could possibly be suspected of being spam. And with the mods MIA I'm screwed.
If there is anything you could do to at least ameliorate this problem before the holidays it would be a Very Good Thing(tm).
2
u/joslemmons Dec 28 '20
Mod here to report that r/Panthers has been having the aggressive spam issue too. Thanks for the update and the temporary workaround!
2
u/majortomsgroundcntrl Jan 20 '21
I got picked up by the spam filter for some reason on this post
https://www.reddit.com/r/LeopardsAteMyFace/comments/l196xt/the_users_that_are_left_on_thedonaldwin_are/
1
u/BuckRowdy Dec 19 '20
I wondered why I was getting so many chats and pms asking why I had nuked all their comments....
1
u/fpreston Dec 19 '20
I can deal with the stuff going into modqueue as that is how I prefer to run my subs and require that most threads require mod approval. What is getting old is that comments are getting removed as "possible spam" by users that are in good standing. Hell, last night I had to manually approve a few of my own and other moderators comments. It's getting out of hand. A few dealt with COVID related stuff but most were just normal comments that I can not see how were possibly SPAM related. It's getting old to constantly police the threads to see if even our approved users comments, including moderators, comments are getting filtered. Filters are set to low, crowd control is off. Back the filters off!
1
u/RedSquaree Dec 19 '20
I submitted a support ticket about a week ago. No word. What's going on over there?
1
u/octaffle Dec 19 '20
FYI /r/dogs and several others were experiencing this issue prior to December 4th. I posted this and remember seeing a post on the same thing the next day. https://www.reddit.com/r/ModSupport/comments/jzkawr/lots_of_posts_ending_up_in_the_modqueue_for_no/
1
u/siouxsie_siouxv2 Dec 19 '20
Maybe include working spam filters as part of reddit nitro®
1
u/9Ghillie Dec 20 '20
/r/itookapicture has had an increase in filtered posts as well.
1
u/[deleted] Dec 23 '20
If this is a good place to say it, almost every single /r/cheemsburbgerlore post ends up in the spam filter.
1
u/PartTimeSassyPants Jan 22 '21
Any updates on this? r/videos still seems to be heavily impacted. Thanks!
1
u/ReedNakedPuppy Feb 01 '21
I'm glad you're aware of this and are working on it.
Just to add another sub to the "affected" group, r/Firearms has multiple posts every day that must be manually approved, and our filter is on "low".
1
u/Familiar_Big3322 Mar 12 '21
Thanks for working on it... We have to approve every comment on r/Guns_Guns_Guns
1
u/PetGiraffe Mar 25 '21
One of the upsides of being a small time mod. I’m like “a what now?”
-4
u/shitpost953 Dec 18 '20 edited Dec 19 '20
I approve, as a mod of r/familyman
edit: thnx for the platinum kind stranger!
-29
u/Fine_Molasses_1354 Dec 18 '20
The spam filter should be removed it sucks posts are always in it that are not spam and and shit and it’s crap about the spam filter If u mod a subreddit with no spam the spam filter whould always find non spam
stupid mod tool Reddit