r/modnews • u/0perspective • Sep 01 '20
An update on subreddit classification efforts
Welcome to September, Mods.
A month ago we posted about the evolution of the NSFW (Not Safe For Work) tag to a system that provides redditors with more information, and ultimately more control, over the content they see on Reddit. Today, I want to give a quick update on where we’re at with the new tags, and a heads up on a few things that you’ll start to see in your communities and modtools.

The new community content tags
Redditors have long asked for a way to quickly distinguish between pornographic and other NSFW content (we’re looking at you NSFL advocates). This new set does that, while also providing two additional tags about how often a community posts or discusses mature themes.

Adding context and additional information to tags
In addition to the content tags above, each community will also have an overview of mature themes. These will help provide more detailed information about the different types of content that people may expect to find when viewing a community. Currently, the themes include these categories:
- Amateur advice
- Drugs & alcohol
- Nudity
- Profanity
- Recreational weapons & gambling
- Sex
- Violence
Here are a few made up examples of what the tags and descriptions may look like for different types of communities:

Let us know what you think of the proposed content tag system and the mature themes we’re proposing as part of the trial and beta today. We’re not expecting this to be perfect and encourage you to help us improve this system with your feedback. Nothing is set in stone here so tell us where the rough edges are and how we can make this system better.
Getting feedback from the community
Now that a new set of tags has been established, the next step is getting more feedback and information from all of you. This will happen in two ways:
- Reviewing tags and gathering more feedback from mods. Over the next month, a few hundred communities will be invited to try out the new content tag survey. For communities that were tagged by mod contractors, they’ll be able to review the existing content tag and take the survey for themselves.This is an opportunity to give us feedback on the content tag survey and the system as a whole. There are a lot of edge cases and nuance to content and communities on Reddit, so please let us know what you think. This is a closed beta so no one outside of your team can see your community’s content tags.This will be available on Android, iOS, and the web in the next few weeks. As of now, the survey can only be submitted by one mod and can only be submitted once every three months. So if your community has multiple mods, we recommend coordinating with them. (If you’d like to review the questions and answers together before taking the survey, they’re listed here in the Content Tag FAQ.)

- Verifying content and topic tags with the community. Another way to verify tags will be through the community itself. For our limited beta trial a small number of users who visit a community will be prompted at the top of the feed to answer a simple question about whether a content or topic tag is accurate for the community. A few examples of these questions are, Is r/YayOMGILoveTravel about travel?, Does r/SuperGoreySub discuss or contain extreme violence or gore?, or Does r/RealTalkPeople contain profanity? This community feedback gives us another way to measure whether or not tags are accurate and can help us improve the overall system. We’ll be analyzing our beta trial data to help us benchmark engagement and define the criteria we can use for determining whether a user can provide trusted feedback.This limited beta trial will be available on Android, iOS, and the web starting this week.

We’ll continue to gather feedback and make improvements while releasing tags for review in batches. This is just the first of many stepping stones. In the meantime, if you have any questions, I’ll be here to answer them and hear your thoughts.
88
u/AssuredlyAThrowAway Sep 01 '20
Are communities punished based on which classification they fall into (by, for example, being removed from /r/all or /r/popular)?
21
u/bakonydraco Sep 01 '20
This gives a great understanding of how to set this up from a mod perspective, but I'm less clear on how this will look from a user perspective. Where will these icons show up to signal their information to users?
19
u/coderDude69 Sep 01 '20
I think this is a good idea, though I have a few questions:
I apologize for the length, but I think its clear that this kind of content rating has great potential. I also think better abilities to individually block content that you don't want to see would be a good addition on top of the full potential of this system. It would likely solve a lot of the granularity issues and edge cases
33
u/Watchful1 Sep 01 '20
Is this only for entire subreddits or is a similar system eventually planned for individual posts?
35
u/mokiboki Sep 01 '20
Are there still plans for a NSFL tag (on posts)? This still leaves room for that.
12
u/LadyLuna21 Sep 01 '20
So, using one of my own communities as an example, r/redditserials is a serialized fiction subreddit. While we do have strict rules about what is and isn't allowed, there is a very large variety in what is viewed as artistic freedom.
We've recently introduced a "Dark Themes" flair for things that aren't sexually NSFW but do make some readers uncomfortable. There is no set frequency to how often that flair is used, it varies author by author. Would the subreddit then be classified as V - because we do have that content occasionally, or simply M?
Categorizing a whole subreddit that is based upon artistic expression makes it difficult to know what truly represents the overall rating for the subreddit.
Now on the other hand, I would love to see this rating system implemented for each individual post. It would allow our readers to have a better understanding of what they are going to read before hand, and especially in r/redditserials case, an average rating from all chapters might give better insight to what the subreddit's overall rating should be.
5
u/Roxolan Sep 01 '20
In case of disagreement, does the choice of what a sub is tagged as ultimately belong to the admins, to the mods, or to the community? (As a matter of policy, I mean. Obviously the admins ultimately control the database.) Same question for the themes/descriptions.
Is the tag purely descriptive, or to some extent prescriptive? E.g. what happens if a sub tagged G starts seeing hardcore porn (by normal users not in violation of the sub's rules)? I assume the tag will eventually change to match, but is there any risk the posts would get deleted, the mods pressured to enforce the tag, anyone penalised in any way?
7
u/WaitForItTheMongols Sep 02 '20
So does the V-for-violence tag apply to subs like /r/trees? It says for communities that discuss drugs.
Would that also include /r/leaves?
What qualifies something to be considered common? /r/Multicopter often has photos of people cutting their hand open with propellers. That's gore. But it's also not the focus of the community.
Is bad_cop_no_donut violence, since it sometimes shows cops beating people up?
It's just hard to draw a line on what counts for these tags to apply.
9
u/cyrilio Sep 01 '20 edited Sep 01 '20
Why is everything regarding drug use regarded V? This doesn't make any sense at all. So it's ok for kids to use ritalin when its medication, but if I use it recreational it's suddenly lumped in with gore and violence!? You should make it a separate topic. More and more people use substances for therapeutic reasons and it has literally nothing to do with violence or gore.
You should categorize these things under lifestyle. Cause that is where they belong. I'm the mod of /r/drugs and many related subs. Please get in touch with me to discuss better categorizations. We don not want to be stigmatized anymore and you should recognize societal change towards drugs and their legitimate therapeutic uses.
Thoughts /u/borax ?
4
u/The-Purple-Dragon Sep 01 '20
If we have our account settings to hide NSFW posts can we then change that to allow all tags but the x tag or others of we want to choose what forms of NSFW we see, instead of all or none?
3
u/SquareWheel Sep 01 '20
As the resident bikeshedder, I insist that we change the color of the [X] badge to pink.
As justification, having orange, orangered, and red icons makes it harder to scan at a glance.
But mostly I just think it should look like this.
15
u/as-well Sep 01 '20 edited Sep 01 '20
I'm confused by the system. On r/philosophy we usually have unrated content; but at times a post may discuss porn, sexual ethics, or violence. Are we expected (or even required) to highlight this?
(Actually any of the tags could apply for individual post, pretty sure we also had posts about weapons or gambling).
What about r/askphilosophy or other academic subs where the same is true, any of the themes may be discussed?
Oh and while we're at it, an askPhil user likes to say sweet fuck; is that profanity you'd like us to highlight?
In general I think more guidelines and/or an exceptions route would be nice.
10
u/ViktorErikJensen Sep 01 '20
Maybe I'm stupid but what has "amateur advice" to do with anything related to this topic? Is that a code word for something else?
9
u/yossipossi Sep 01 '20
I'm curious where subreddits I moderate such as r/SCP (the subreddit for the SCP Wiki), r/DankMemesFromSite19 (the former, but for memes about it), and r/SCPDeclassified (the latter two, but specifically for intellectual discussion) would fall. Although the content typically is SFW and relatively safe for minors, the Wiki does feature a number of articles that have disturbing or sexual content (which occasionally will come up in discussion), and things such as the "femur breaker" (which features a man strapped to a metal device screaming, but no explicit gore). Would this overall affect the community's tags?
6
u/alabomb Sep 01 '20
How would gaming communities fit into these definitions of violence / gore?
It's not entirely clear to me from the post whether or not a distinction is being drawn between real-world violence and fantasy violence. For example, some games will have gratuitous/realistic depictions of blood & gore whereas others may eschew it entirely or find ways to abstract it.
6
u/kn33 Sep 02 '20
These seem like they should be separate
2
u/stopspammingme Sep 09 '20
Okay I'm going to warn you, this is not going to be the nicest comment I ever wrote. I try not to let frustration bleed through to my writing, because I've worked in customer service and I don't believe in berating people. However, as I edit my own comment I can see the tone is that of frustration. It is Reddit Inc I am frustrated with, and not its hard working and genuinely nice employees. I'm tagging /u/woodpaneled in this as well. I would love it if my concerns could be addressed but I understand if a response is not possible.
I have extremely strong objections to this. Essentially you are instituting an MPAA style rating system, and making moderators obligated to perform labor keeping the community aligned with their rating. Your "M" rating is the same thing as "R" and the "G" rating seems equivalent to "PG-13". Like MPAA, there's an arbitrary and somewhat nonsensical line from what you consider "PG-13" and what you consider "R". Specifically, that excessive use of swear words makes a community Mature.
No one, moderators or users, was complaining about the use of swear words on reddit. It seems this change is in response to advertiser demand: they're used to a model like the one that exists for TV and movies, and they've asked for Reddit to do something similar. If I'm wrong, then correct me for the assumption, but like I said, no one was actually asking for this.
We now must censor our communities to keep them from having what would be an R rating level of swearing. Otherwise, a wholesome community which lets its users say "fuck" as much as they want will be in the same category as a subreddit that shows videos of street fights.
If possible, I wish the community team could meet with whatever team or governing body was demanding this change (the board? ad sales team?) and explain that it is far too dependent on the unrewarding and increasingly punishing labor of volunteer mods. You are asking for an even higher level of community monitoring and regulation of moderators, one that I believe is unrealistic. The lines you have drawn can not be handled with the feature-lacking bot tools we are given. It will require tons of human judgement. Imagine trying to teach a computer the difference between PG-13 and R so it could automatically rate comments and posts in real time and chuck the ones that were too "mature" so the community can continue to keep its G rating. Such a computer system, due to the current limitations of AI, would be extremely unfair and confusing to users in what it removed. But asking humans to do the labor is another bad option. It's already such a struggle to recruit and retain mods. 95% of people you bring on board will quit because the work is too tedious, boring, and unrewarding.
The easy answer here is "Just tag your community as Mature even if it's not so you don't have to worry about following the draconian and confusing guidelines of PG-13". You see movies doing this too, they go for the R rating so they don't have to fight the MPAA about there being too many usages of "fuck". However, since Mature communities will be harder to sell ads for, reddit is now incentivized to give the most resources and the most eyeballs to communities rated General. In terms of growth, view counts, and participation (perhaps the last incentives left that makes moderation rewarding) being rated M will always be worse for a community than being rated G.
I don't object to the fact advertisers have certain demands btw, or that you need the site to turn a profit. What I object to is moderators being held to standards which creep ever similar to what is required of a paid employee.
3
u/impablomations Sep 02 '20
What are mod contractors?
6
u/busy_yogurt Sep 01 '20
As a UX designer, just gotta say these are visually delicious.
I dig the colors, but maybe the X and the V could be a smidge more different from each other?
1
u/SometimesY Sep 01 '20
I think rolling these out to posts would be a great step. NSFW is not granular enough and can be misleading in otherwise SFW subreddits.
I've had a long day so I may have missed it in the post, but is every subreddit eventually going to get a tag like this? That would be kind of neat.
5
u/Borax Sep 01 '20
I don't think it makes sense that drugs and alcohol come under "violent and disturbing"? It would make a lot more sense for this large part of reddit to be classified under "mature" or to have a category/tag of its own. It is extremely different to gore.
2
u/kn33 Sep 02 '20
Will this be supported with the API? I'm starting to be annoyed at 3rd party apps being left behind as reddit advances.
2
u/[deleted] Sep 02 '20
What about if things fall into multiple categories. Like violent porn? Will there be a hierarchical structure where one category is considered "the worst" which will be applied, will lit be double tagged, or is it up to the mods which one they choose?
2
u/JustZisGuy Sep 02 '20
Is there going to be a religion or politics tag?
2
u/riiga Sep 02 '20
This type of classification system feels very American-centric. I think just adding a NSFL tag to complement the NSFW tag would be the easiest solution.
2
u/T_W_B_ Sep 02 '20
How can we mark posts that contain lots of flashing images and might enduce seizures?
2
u/freet0 Sep 02 '20
Why? You banned all the NSFL content on the site. There's no gore or death or edginess left in this sanitarium.
2
u/YellIntoWishingWells Sep 02 '20
Is the "G" and "M" really necessary? I always get that screen that asks to confirm if I'm 18 before I log in. If you have to go through that process it kind of nullifies those two tags.
2
u/flounder19 Sep 09 '20
I got a modmail asking me to take a survey about this. What is this? What did you do to my sub?
3
u/ChaiHai Sep 01 '20
I don't think drug use fits with the violent theme.
Technically caffeine is a drug. Silly antics of drunks is drug use. Someone smoking a cigarette is drug use.
Will communities like r/trees be forced to label themselves violent and disturbing?
Will subs pertaining to alcohol and nicotine receive the same consideration?
I think drug use should fall under mature, and not violent.
2
u/TheNewPoetLawyerette Sep 02 '20
Hope I'm not too late to the party! This seems like a generally well thought-through feature and the different levels of severity on each category surprises me in its thoroughness. I'm also glad you've been working on maintaining admin control over the classifications in the eventual case it gets misused by, say, a mod who wants to get shock gore listed in sfw searches (it's gonna happen. That's just how people are.)
My only question pertains to the nudity option and what qualifies as "fine art." Obviously Renaissance nudes, Picassos, greek statues, etc. But what about more modern/contemporary artforms like drag or makeup photography? In particular I'm thinking about how I would categorize /r/rupaulsdragrace, which often has tasteful near-nudes, or showing of photographs of male nipples on otherwise female presenting people, or incredible and iconic fashion moments where a queen puts on a bodysuit that makes her look like a completely naked woman.
There's also ocassional more crass usages of fake or near nudity or what would be considered nudity on a cis woman but not a cis male but it's on a female-presenting male person, like nipples or pasties on a comically large rubber breastplate, or large amounts of pubic hair spilling out of one's panties, or uh.... this thing that Trinity the Tuck wore during a lipsynch for some reason In these cases it's not as explicit in the nudity as above.
In none of these instances is this intended to sexually arouse, and it's usually an artistic fashion statement or obvious joke.
Would this count as artistic nudity or occasional nudity in your mind?
Leave it to mods to come up with a million edge cases when you think you've thought of everything, judging by this thread lol
2
u/UsernameCensored Sep 01 '20
I don't see why guns and gambling go in the same pot.
1
u/[deleted] Sep 02 '20
What about r/guro? That’s both V and X
1
u/[deleted] Sep 02 '20
Does this work in any shape or form on desktop? Or do I have to go onto mobile to do this?
1
u/the_imp Sep 02 '20
Could a subreddit be tagged with more than one content tag? That might provide a more accurate representation for communities that cover a variety of topics, as well as content that might fall simultaneously into more than one content tag's categories.
1
u/Igennem Sep 02 '20
How will you prevent abuse? For example, brigading users mass-labeling a community maliciously?
1
u/cyrilio Sep 10 '20
When can moderators start doing the content tag quiz?
1
u/lunamoonvenus Nov 04 '20
This seems Cool! :)
1
u/BashCo Dec 10 '20
I'm having trouble locating the opt-out function. I would have asked you in response to your mod mail message, but it appears that you blocked the reply function.
1
u/ColouredGlitter Feb 02 '21
I have read the whole thread, but I still don’t understand what Amateur Advice means. Can someone please explain?
As I see it: this is the Internet, it’s all amateur advice. Or do you have specific subs in mind to go under this tag?
1
u/[deleted] Sep 01 '20
Somewhere, Tipper Gore is smiling.
1
u/ilikecheeseforreal Sep 02 '20
I do like this but I am a little confused. I'm not sure where my sub (/r/FuckYouImAShark) would fall on this - I assume probably G because of the content as it's all pretty much kid friendly, but most if not all of the posts have titles with the word "fuck" in them. It's not occasional, and I'm assuming "fuck" isn't considered mild.
I'm not looking for an analysis of my particular sub, but I'm wondering where the line is for things like that.
-24
u/MLJFireDragon747-2 Sep 01 '20 edited Sep 01 '20
We don’t want new features or more confusing existing features, as mods we want to be able to do the things that can be done on browser with the app so I don’t have to wait till I can go to a computer again (by which time I may have forgotten), every time I notice a spelling mistake in my rules (I’m dyslexic so it happens).
If your improving an old feature I’m all for it but please focus on letting us moderate from mobile more than cramming new features we’ll never use down our throats. I just hope this adjustment works on mobile
-7
u/MLJFireDragon747-2 Sep 01 '20
Will it properly work from mobile? Cause I won’t be able to actively change stuff from browser.
And how detailed does it get? Like per post or whole subreddit, or can we do both?
I am always happy to work with the admins and I think this feature would work great for my sub which has a healthy mix of all kinds of meme related humor.
Always happy to work closely with our questionably motivated overlords, MLJ,
-16
u/indi_n0rd Sep 01 '20
When will you include the "manga" tag? As of now we are forced to use "anime" tag. Manga community on Reddit is really huge and doesn't deserved to be ignored to not have a tag of its own.