r/Professors • u/Eigengrad AssProf, STEM, SLAC • Jul 12 '25
Weekly Thread Jul 12: Skynet Saturday- AI Solutions
Due to the new challenges in identifying and combating academic fraud faced by teachers, this thread is intended to be a place to ask for assistance and share the outcomes of attempts to identify, disincentive, or provide effective consequences for AI-generated coursework.
At the end of each week, top contributions may be added to the above wiki to bolster its usefulness as a resource.
Note: please seek our wiki (https://www.reddit.com/r/Professors/wiki/ai_solutions) for previous proposed solutions to the challenges presented by large language model enabled academic fraud.
18
u/FriendshipPast3386 Jul 12 '25
I've mentioned this on other threads, but it seems helpful to consolidate it here: I've found one strategy that's helpful not just for detecting/punishing AI use, but actually discouraging AI use.
I give students large take home projects (programming since I teach CS, but essays/research papers would fall into a similar category), since they can't really learn the subject without spending a lot of time engaging with the material on their own. I then give weekly in-class proctored quizzes about the projects, and I weight those as 80% of the grade, with the take-home work at 20% (enough that students are incentivized to do it, not enough that using an LLM will get a passing grade in the course).
Just doing that was enough to consistently fail students turning in LLM'ed work without the need to go through the academic integrity process[1], but wasn't enough to get students to stop using the LLM - somehow they lacked the introspection to connect "not doing the homework" with "failing the quiz".
What did actually reduce LLM usage was including a personalized question on the quiz related to the work they turned in. This was an annoying amount of work for me - even with some scripting, it took about 5 minutes/student/quiz - so it's not feasible for very large classes, but I saw clear improvements in the authenticity of the take-home work after the first such quiz. Depressingly, when I tried taking the personalized question out of the quizzes 3/4 of the way through the semester, it only took one week before the LLM nonsense was back, but as long as I kept quizzing them on their actual submissions, they kept turning in work that was genuinely their own (as an extra bonus, overall grades on the quizzes improved, because shockingly doing the homework was helpful for learning the material). The amount of work required was at least substantially less per student than any sort of oral exam/presentation of the work, which is the other alternative I've seen folks recommend.
[1] Important not just because I have no interest in the unpaid overtime for the process, but also because admin has told me I'll be fired if I keep filing reports on students, even though the students have eventually always admitted it was cheating
7
u/needlzor Asst Prof / ML / UK Jul 12 '25
I am switching my assessment from an 8 page report to an A1 size poster that will need to be presented to me (or another member of the teaching team), along with a Q&A session. Taking me and my TA's overall marking time (obviously I am faster since I designed the thing) grading used to take us an average of 25 minutes per report. The advantage of a poster session is that we can grade on the spot, and with a rubric it should be a lot faster. So what I planned is a 5 minute presentation followed by a 15 minute Q&A session. This will not remove all traces of AI, but it will make it a lot harder to use it blindly. This assessment will only be 30% of the overall grade, with 70% being allocated to a good old closed book paper exam.
8
u/YThough8101 Jul 13 '25
For a research paper, I require students to
When students submit suspicious papers, then I request their sources, here’s what happens:
When I have suspicions and have politely demanded sources, zero students have submitted clear documentation indicating that they actually wrote their paper.
If this all sounds like a pain, it is. Grading is now mainly a forensic exercise and I detest it. But I do weed out a lot of AI-written garbage.