"An iron law of running a large internet service is that your users will figure out how to use it to share, consume, or make porn. Explicit adult chatbots preceded ChatGPT by many years, and as soon as widely available and far more fluent and flexible LLMs showed up, it was inevitable that a meaningful portion of new users would wonder how far they could push them sexually."
"Every big internet company has to figure out what its relationship to porn is going to be. Search engines settled on solutions like SafeSearch, giving users the option of whether they wanted to see adult content; social-media companies drew a wider range of boundaries, from Meta's systematic prudishness to Tumblr and Twitter's fairly open embrace of porn; mobile platform companies like Apple and Google kept most adult apps out of their app stores."
"So far, all the big AI companies have come up with slightly different answers to their version of the porn question. Elon Musk is all for it with adult modes and sexualized avatars in Grok (as well as extremely permissive rules for its image-generation tools, which led to instant and widespread abuse). Meta allows 'romantic' role-play with guardrails that don't seem to work very well."
Large internet services inevitably attract users seeking adult content, a pattern established long before AI chatbots. Major tech companies have historically addressed this through different strategies: search engines implemented filtering options, social platforms set varying boundaries, and app stores restricted adult applications. AI companies now face similar decisions regarding sexual content in LLM-based chatbots. Elon Musk's Grok permits adult modes and sexualized avatars with permissive image-generation rules. Meta allows romantic roleplay with limited guardrails. Google maintains caution while partnering with Character.ai, a roleplay platform linked to adult conversations and legal concerns. Anthropic focuses on enterprise clients and avoids image generation entirely. These divergent approaches reflect each company's distinct business model and risk tolerance.
#ai-content-moderation #adult-content-policy #llm-chatbots #tech-company-governance #platform-regulation
Read at Intelligencer
Unable to calculate read time
Collection
[
|
...
]