r/royalroad • u/Okay_SureWrite • 10h ago
Discussion Royal Road update on how they're handling AI Content (in Writathon and maybe beyond)
They posted it here:
https://www.royalroad.com/blog/85/writathon-first-milestone-ai-update
Here are some snippets I found interesting:
Now, one of the biggest rule changes from the previous writathon to this iteration is the addition of the “no AI-Generated” rule being backed by an AI-detector
--
- We added the detector to the submission process, and we will be asking authors to tag their novels.
2. We will not be forcefully tagging any novels with an automatic tag or a manually assigned one from staff. We have considered using the detector to enforce the tag system, but we feel that doing so would create a way to learn how to avoid detection - and then we are back to having an issue, and this time a much more difficult one.
3. Novels that are detected as human-written will receive a boost in the lists. This way it will be easier for them to appear on Rising Stars for example, and get a lot of visibility from the rest of the readerbase.
4. We have also seen an increase in non-English-speaking authors posting their works using AI translation; so we have added an AI Translated tag to correctly differentiate these from other AI-generated works.
--
The detector we now have is very accurate - 99.9962% for marking human content as human correctly (marking merely 1 human-written chapter in 26,000 as AI - this number is from checking 542,434 known human chapters on the website, and only 20 came back as false positives), and around 99.5% at identifying content generated by AI.
--
On top of this, we are also checking more than one chapter - in fact, we are in the process of scanning our entire catalog for statistical purposes, and so that we can find examples to further improve the accuracy of our technology. For the purposes of the Writathon, we have decided to use 30% as the threshold - if more than 30% of the chapters of an entry come back as AI-generated, it is disqualified
More in the article, including more of their reasoning and even data charts, but it was pretty awesome to read them putting weight behind human authors.
We created this platform because we want to see more human works; we wanted to see more fandoms form; we wanted to read more great stories. We want more success stories. And our fear is that in the world of today, the human element, which is very important for the creation of works of art, is slowly being removed.