ChatGPT reported Florida man to FBI after he told AI disturbing details of murder plot
Warning: This article contains discussion of rape which some readers may find distressing.
Disturbing messages exchanged with popular AI chatbot ChatGPT has forced parent company to report a Florida native Darren Zhou, 25, to the FBI, as he allegedly shared detailed plans of a plot to rape and murder his girlfriend.
Zhou took to ChatGPT after he broke up with his girlfriend following a six-month relationship, with the AI-based discussions surrounding her hobbies, the places that she regularly visited, his desire to rekindle the relationship, and his feelings of jealousy when men were around her, as per The Detroit News.
His actions clearly escalated with the chatbot, however, as he began to share violent thoughts and eventually outlined his intention to murder his ex-girlfriend, writing:
Advert
"I'm gonna kill her by the end of this month. If I can't have her then nobody can."
That's when OpenAI decided to intervene and report Zhou to federal authorities, with the AI giant having a small team of 'observers' for this very purpose when instances of harm are detected in conversations with its flagship tool.
OpenAI reported ChatGPT to FBI after concerning messages
It appears as if the company will only inform law enforcement in cases that are deemed to be serious enough, with Zhou's threats understandably taken seriously by the moderators.
Investigating over two months of chat logs between Zhou and the ChatGPT model he was frequently conversing with, the FBI discovered not only threats to kill his ex-girlfriend, but also plots to rape, alongside suggestions of a murder-suicide plan.
Agents detailed that Zhou's messages did not match the description of 'vague emotional outbursts', but instead displayed the sign of rehearsal and planning that sparked the suggestion he was going to go ahead with his threats.
Critically, investigators were not granted access to the messages sent by ChatGPT in the logs provided by OpenAI, with only Zhou's correspondence reviewed by the FBI.
Zhou charged in court, but avoids prison sentence
After information was provided by OpenAI to the FBI, Zhou was arrested in May and subsequently spent two days in the Palm Beach County jail, being granted release after meeting the $100,000 bail requirements set by the court.
He then was charged the following month with aggravated stalking, written threats to kill, and illegal use of a cell phone. Despite these combined charges potentially landing Zhou with up to 25 years in prison, he walked away with just eight years of probation, avoiding jail time and a felony conviction in the process.
Zhou had pleaded guilty to all three counts, but managed to strike a deal with Assistant State Attorney General Ana Cuskova, which was also approved by Zhou's ex-girlfriend and the subject of his threats.
His probationary period will leave him subject to a number of restrictions, and it appears as if his spotless prior criminal record and impressive scholarly performance contributed to the reduced punishment.