In 2023, reports of suspected child sexual exploitation skyrocketed, notably through online platforms, with the National Center for Missing and Exploited Children (NCMEC) documenting over 36 million reports. A report by Graphika highlights the alarming emergence of AI chatbots designed for sexualized roleplay involving minors. More than 10,000 such chatbots were found, particularly proliferating on platforms like 4chan. The study revealed a contentious dialogue online about the existence and creation of these harmful chatbots, raising significant ethical concerns regarding their impact and the participation of minors on these platforms.
There was a significant amount of sexualized minor chatbots, and a very large community around the sexualized minor chatbots, particularly on 4chan.
There’s a lot of creativity in terms of how individuals are creating personas, including a lot of harmful chatbots, like violent extremist chatbots and sexualized minor chatbots.
In more of the mainstream conversations that are happening on Reddit or Discord, there is disagreement related to the limits as to what chatbots should be created.
Some of the sexualized chatbots that Graphika found were jailbroken versions of AI models developed by OpenAI, Anthropic and Google, advertised as being accessible to nefarious users.
Collection
[
|
...
]