Can AI detectors prevent cheating? A Classroom Experiment!
https://www.washingtonpost.com/techno...
The rise of ChatGPT is challenging traditional methods of maintaining academic integrity in schools. While AI detectors are frequently recommended, there is scant concrete evidence supporting their effectiveness at the secondary level—most existing studies fail to account for how adeptly students use social media to bypass these systems. I conducted an experiment with secondary school students aged 12-17, deliberately challenging them to outsmart various AI detectors. This video presents the alarming results, underscoring the urgent need for more robust solutions in educational technology.
Links to research papers:
Walters, W. (2023). The Effectiveness of Software Designed to Detect AI-Generated Writing: A Comparison of 16 AI Text Detectors. Open Information Science, 7. https://doi.org/10.1515/opis-2022-0158.
Sadasivan, V., Kumar, A., Balasubramanian, S., Wang, W., & Feizi, S. (2023). Can AI-Generated Text be Reliably Detected?. ArXiv, abs/2303.11156. https://doi.org/10.48550/arXiv.2303.1....
Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S. et al., “Testing of detection tools for AI-generated text,” Int J Educ Integr 19(26), https://doi.org/10.1007/s40979-023-00... Dec. 25, 2023
Timestamps:
0:00 - Introduction: The Growing Challenge of ChatGPT in Education
0:01:09 - Research Evidence of the Limitations of AI Detectors
0:02:12 - Setup of the Classroom Experiment
0:03:25 - Presentation of Experiment Results
0:05:10 - Counter Arguments
0:05:48 - Alternative Methods
Subscribe and join the discussion—how can we effectively use technology to uphold academic integrity? Click the follow button for more updates and discussions on this pressing issue. Thanks for watching!
@CambridgeInt @TesForTeachers @iborganization @pearsonedexcel2197
#internationalbaccalaureate #schoollife #EdTech #AIinEducation #AcademicIntegrity #classroom #EducationReform #chatgpt #teacherlife #EdChat #Teachertips #EducationReform #ProfessionalDevelopment #headteacher
Additional resources
https://www.change.org/p/ban-ai-writi...
“Can Using a Grammar Checker Set Off AI-Detection Software?: A college student says she was falsely accused of cheating, and her story has gone viral. Where is the line between acceptable help and cheating with AI?”, EdSurge, https://www.edsurge.com/news/2024-04-... April 4, 2024.
Perkins, M., Roe, J., et al., “GenAI Detection Tools, Adversarial Techniques, and Implications for Inclusivity in Higher Education,” arXiv, arXiv:2403.19148, Mar. 28, 2024.
Pan, W. H., Chok, M., J., et al., “Assessing AI Detectors in Identifying AI-Generated Code: Implications for Education”, arXiv, https://arxiv.org/abs/2401.03676 Jan. 8, 2024.
Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S. et al., “Testing of detection tools for AI-generated text,” Int J Educ Integr 19(26), https://doi.org/10.1007/s40979-023-00... Dec. 25, 2023. - “our conclusion is that the systems we tested should not be used in academic settings.”
Carter, T., “Some universities are ditching AI detection software amid fears students could be falsely accused of cheating by using ChatGPT”, Business Insider, https://www.businessinsider.com/unive... Sep. 22. 2023.
Edwards, B., “OpenAI confirms that AI writing detectors don’t work: No detectors ‘reliably distinguish between AI-generated and human-generated content’,” ARS Technica, https://arstechnica.com/information-t... Sep. 8, 2023.
Liang, W., Yuksekgonul, M., et al., “GPT detectors are biased against non-native English writers”, arXiv, arXiv:2304.02819, Apr. 6, 2023.
Sadasivan, V. S., Kumar, A., et al., “Can AI-Generated Text be Reliably Detected?”, arXiv, https://arxiv.org/abs/2303.11156 Mar. 17, 2023.