AI porn generators are improving and proliferating. The app has over 350,000 users and half a million images generated daily. AI porn raises ethical and legal concerns. The document reports that Unstable Diffusion is trying to rebrand itself as a platform for creativity and expression, not just porn.
This is the summary of a recent report by the Center for Digital Ethics and Policy, which examines the phenomenon of AI-generated pornography and its implications for society. AI porn, also known as deep fake porn, uses artificial intelligence to create realistic images and videos of people without their consent or knowledge. The report reveals that one of the most popular apps for creating AI porn, Unstable Diffusion, has over 350,000 users and generates more than half a million images per day.
The report also explores the ethical and legal challenges posed by AI porn, such as privacy violations, identity theft, revenge porn, blackmail, harassment, and defamation. It argues that AI porn can cause serious harm to individuals and groups, especially women and minorities, who are often the targets of such content. The report calls for more regulation and accountability from the platforms that host and distribute AI porn, as well as more education and awareness among the public.
Also, there comes a lot of pressing questions about when these AI tools can create adult contents that mimic the likeness of some well-known people. This raises concerns about possible defamation when such images are created. There is always an aspect of this that can lead to blackmail and other forms of crime. Fraud is also a concern. Where is the line drawn in these concerns? With the claim of this being art, where does it stop when it can lead to harm?
Unstable Diffusion comes with some boundaries images that can be created on their platform. One might argue that content moderation is contrary to Unstable Diffusion’s mission. However, this is not the case. Unstable Diffusion does have some boundaries for the images that it generates, such as pornographic deepfakes of celebrities and porn depicting characters who appear to be 18 years old or younger — fictional or not. These are images that could expose Unstable Diffusion to legal risks and ethical concerns
One of the interesting findings of the report is that Unstable Diffusion, the app behind most of the AI porn content online, is trying to rebrand itself as a platform for creativity and expression, not just porn. The app claims that it allows users to create their fantasies and explore their sexuality in a safe and fun way. The app also offers features such as filters, stickers, backgrounds, and text to customize the images. However, the report questions the sincerity and effectiveness of this rebranding strategy, given that the app still relies on non-consensual images of real people as its main source of data.
The report concludes that AI porn is a complex and evolving phenomenon that requires more attention and action from various stakeholders, including policymakers, researchers, activists, and users. It urges everyone to be more critical and responsible when consuming or creating AI porn content and to respect the dignity and rights of others.
