Teenagers’ language might make online bullying hard to detect
Vitapix/Getty Images
Generation Alpha, the cohort born between 2010 and 2025, is using internet lingo that is evolving rapidly, posing challenges for parents, teachers, and AI systems in detecting online bullying and grooming. A recent study conducted by Manisha Mehta, a 14-year-old student at Warren E Hyde Middle School in Cupertino, California, and Fausto Giunchiglia at the University of Trento, Italy, examined 100 popular phrases used by Generation Alpha on various online platforms.
Mehta and Giunchiglia enlisted 24 volunteers aged between 11 and 14 to analyze these phrases and determine their meanings, context, and potential safety implications. The study revealed that while 98% of the Generation Alpha volunteers understood the basic meaning of the phrases and 92% could detect harmful intent, AI models and adults, including parents and professional moderators, struggled to recognize harmful language, with AI models only identifying harmful use in about 4 out of 10 cases.
Some of the phrases used by Generation Alpha have double meanings, making it challenging for traditional safety systems to detect potential harm. For example, “let him cook” can be both praise and mockery, while “kys” has shifted from “know yourself” to a harmful phrase suggesting self-harm. Understanding this evolving language is crucial to protect vulnerable young people online.
Mehta emphasized the importance of AI systems being able to comprehend and flag harmful language to enhance online safety measures. The study findings were presented at the Association for Computing Machinery Conference on Fairness, Accountability, and Transparency, highlighting the need for improved content moderation systems to safeguard young internet users.
Michael Veale from University College London noted the significance of addressing deficiencies in content moderation systems, especially in protecting young individuals online. Companies and regulators must adapt to the rapidly changing online landscape to ensure the safety of younger users.
Topics:
