OpenAI launches child sexual abuse content detection tool
Nov 17, 03:26
On November 17, according to The Verge, OpenAI has launched a classification tool designed to identify child sexual abuse imagery, which can tag AI-generated content, and is being offered free of charge to vetted organizations.
OpenAI stated that the tool reduced the number of flagged images by 48% and doubled the likelihood that flagged images contained abusive content. The tool is designed to detect harmful images generated by a variety of sources, including open-source models and stripping apps.
Additionally, users attempting to generate such content via ChatGPT will receive a warning; first-time violators will be suspended for 24 hours and provided with relevant support resources.