OpenAI, the developer of ChatGPT, is currently exploring the idea of allowing users to generate pornography and other explicit content using artificial intelligence.
Although the company maintains its ban on deepfakes for adult content, some activists argue that this proposal goes against OpenAI’s pursuit of creating “safe and beneficial” AI.
OpenAI, known for developing the DALL-E image generator, is considering enabling users to responsibly create “Not Safe for Work (NSFW)” content, including erotica, extreme gore, defamation, and unsolicited profanity through its products.
The company is seeking feedback on this potential feature to ensure it aligns with user and societal expectations while maintaining age-appropriate standards.
Joan Jiang, an employee at OpenAI, raised the question of whether the company should allow the generation of erotic text or nude images, emphasizing that deepfakes will not be permitted.
Despite the consideration of enabling NSFW content creation, OpenAI aims to provide maximum control while adhering to legal and ethical standards, ruling out the creation of AI porn.
OpenAI acknowledges the importance of discussions around content that may include sexuality or nudity, emphasizing the need for an age-appropriate context in such cases.
There have been concerns raised about the prevalence of AI-generated porn, prompting actions such as temporary bans on explicit deepfake images on platforms like X, previously known as Twitter.
In response to the potential risks posed by AI-generated explicit content, organizations like the Internet Watch Foundation are actively monitoring and raising awareness about the misuse of AI to create harmful material.
Critics, including children’s online safety campaigner Bevan Kidron, have expressed disappointment in tech companies like OpenAI considering commercial opportunities in AI erotica rather than prioritizing harm prevention.
Legal experts, such as Claire McGlynn, remain skeptical about tech companies’ ability to produce adult content responsibly, citing the need for stricter safeguards and corporate responsibility.
OpenAI’s guidelines emphasize compliance with applicable laws, prohibiting sexually explicit or suggestive content while allowing for exceptions in scientific or educational contexts.
While OpenAI’s technology has restrictions in place to prevent the creation of explicit content, ongoing discussions and collaborations with artists and creators aim to understand user needs and preferences for AI tools like Sora.
Source: www.theguardian.com