- Joined
- Aug 15, 2020
- Posts
- 5,402
Schools are employing dubious AI-powered software to accuse teenagers of wanting to harm themselves and sending the cops to their homes as a result — with often chaotic and traumatic results.
As the New York Times reports, software being installed on high school students' school-issued devices tracks every word they type. An algorithm then analyzes the language for evidence of teenagers wanting to harm themselves.
Unsurprisingly, the software can get it wrong by woefully misinterpreting what the students are actually trying to say. A 17-year-old in Neosho, Missouri, for instance, was woken up by the police in the middle of the night.
As it turns out, a poem she had written years ago triggered the alarms of a software called GoGuardian Beacon, which its maker describes as a way to "safeguard students from physical harm."
"It was one of the worst experiences of her life," the teen's mother told the NYT.
futurism.com
As the New York Times reports, software being installed on high school students' school-issued devices tracks every word they type. An algorithm then analyzes the language for evidence of teenagers wanting to harm themselves.
Unsurprisingly, the software can get it wrong by woefully misinterpreting what the students are actually trying to say. A 17-year-old in Neosho, Missouri, for instance, was woken up by the police in the middle of the night.
As it turns out, a poem she had written years ago triggered the alarms of a software called GoGuardian Beacon, which its maker describes as a way to "safeguard students from physical harm."
"It was one of the worst experiences of her life," the teen's mother told the NYT.
Schools Using AI to Send Police to Students' Homes
Schools are employing dubious AI-powered software to accuse teenagers of wanting to harm themselves — and sending the police to their homes.
futurism.com
