Connect with us

Technology & Computing

Unstable Diffusion is a group that aims to make money from AI

Published

on

NSFW discord servers Stable Diffusion, a text-to-image AI that was developed by startup Stability AI earlier this year, was quickly open-sourced. The internet soon began to use it for porn-creating. Reddit and 4chan used the AI system to create realistic, anime-style images of nude characters. These included mostly women.

Reddit shut down subreddits devoted to AI porn quickly, and NewGrounds communities, which allow some forms of adult artwork, ban AI-generated art altogether. However, there were new forums to fill the void.

Unstable Diffusion is the biggest. Its operators are creating a business around AI systems that generate high-quality porn. The server’s Patreon, which was started to maintain the server as well as fund general developments, currently brings in more than $2,500 per month from several hundred donors.

Advertisement

“In only two months, we expanded our team to over 13 people, as well as many consultants, and volunteer community moderators,” Arman Chandhry, one member of the Unstable Diffusion admin group, said to TechCrunch via Discord.

NSFW discord servers :We see the potential to innovate in usability, user experience, and expressive power to create tools 

NSFW discord servers

Unsurprisingly, not all AI ethicists are equally worried as Chaudhry. Although the use of AI to generate porn is not new, TechCrunch featured an AI-porn-generating application just months ago. However, Unstable Diffusion models can produce higher-fidelity examples than many.

According to ethicists, the generated porn could have adverse consequences, particularly for marginalized people, such as the adult actors and artists who make a living making porn for customers’ fantasies.

Ravit Dotan (VP of responsible AI at Mission Control), stated that the risks included placing unreasonable expectations on women’s bodies, sexual behavior, violating women’s privacy and copyrights, feeding the algorithm with sexual content without consent, and making it impossible for women to get a job in the porn industry.

Advertisement

“The disparate impact AI-generated porn makes on women is one aspect I am particularly concerned about. An AI-based app that could ‘undress’ people previously only worked on women.

NSFW discord servers: Be humble in your beginnings

Unstable Diffusion was created in August, around the same time as the Stable Diffusion model. It started as a subreddit and eventually moved to Discord where it now has around 50,000 members.

“Basically, we are here to support people interested in making NSFW,” a Discord server administrator, AshleyEvelyn wrote in August. “Because 4chan is the only community working on this, we hope to create a more reasonable community that can work with the wider AI community.”

Unstable Diffusion was initially created to share AI-generated porn and bypass image-generating app content filters. Soon though, many of the server admins started exploring ways to create their own AI systems for porn creation on top of open-source tools.

Advertisement

Stable Diffusion was a natural fit for their efforts. Although the model was not designed to produce porn, Stability AI does not prohibit developers from using Stable Diffusion to make porn.

However, it is permissible for Stable Diffusion to be modified by others so long as it doesn’t violate any laws or cause harm to others. The company’s governance approach is laissez-faire, and it falls on the AI community, to responsibly use Stable Diffusion.

NSFW discord servers: Stability AI did not respond to a request for comments.

To get started, the Unstable Diffusion admins created a Discord bot. It was powered by vanilla Stable Diffusion and allowed users to generate porn simply by using text prompts.

The bot produced a few errors in the result: the bot often generated nude figures with misplaced limbs or distorted genitalia.

Advertisement

Stable Diffusion, an out-of-the box AI system, didn’t have enough exposure to porn to be able to achieve the desired results. Like all text-to image AI systems, Stable Diffusion was trained using billions of captioned photos to understand the relationships between images and written concepts.

For example, the word “bird” could refer to parakeets, bald eagles, and bluebirds. Stability AI, a company that specializes in fair use, claims many of the images are copied from ArtStation and Flickr. This precedent will soon be challenged in court.

Stable Diffusion only contains 2.9% of its dataset that contains NSFW material. This leaves the model with very little information regarding explicit content.

The Unstable Diffusion admins recruited Discord members to create porn datasets to fine-tune Stable Diffusion. This is similar to how you would give Stable Diffusion more photos of chairs and couches if you were to build a furniture generation algorithm.

Advertisement

While much of the work is still ongoing, Chaudhry told me that some of it was already in place, including a technique to “repair” AI-generated arms and faces.

He said that he is recording and addressing the challenges all AI systems face, including collecting diverse data that is rich in image quality, captioned richly, with text, and covering the gamut o our users’ preferences.

These custom models power Discord’s bot and Unstable Diffusion’s in-progress web app. The admins claim that this will eventually allow users to follow AI-generated porn.

NSFW discord servers: Growing community

Unstable Diffusion hosts AI-generated porn today. It features a variety of art styles, sexual preferences, and kinks. There is a “men only” channel, a softcore stream and “safe for Work” stream, channels to hentai or furry artwork, a BDSM subgroup and a channel for “nonhuman nudes.

Advertisement

 These channels allow users to invoke the bot to create art that matches the theme. If they are particularly pleased with the results, they can submit it to a “starboard”.

Unstable Diffusion claims that it has generated more than 4,375,000 images. The group holds semi-regular competitions in which members are challenged to create images with the bot. These results are then used to improve Unstable Diffusion’s models.

Unstable Diffusion hopes to grow and become an ethical community for AI-generated porn. Unstable Diffusion is committed to preventing porn such as child pornography, deepfakes, and excessive gore. The Discord server users must adhere to the terms of service.

They also have to submit to moderation for any images they create. Chaudhry claims that the server uses a filter to prevent images from containing names of people and has a full-time moderation staff.

Advertisement

He stated that only law-abiding and fictional generations are allowed on Discord. “For professional tools, and business applications we will revisit the moderation and filter rules and work with partners to ensure they are in line with their commitments and needs.”

Unstable Diffusion’s systems may become more difficult to monitor, as they are made available more widely. Chaudhry did not outline plans to moderate content from the web app, or Unstable Diffusion’s forthcoming subscription-based Discord chat bot. Third-party Discord server owners can deploy these bots within their own communities.

“We must… consider how safety controls could be subverted when API-mediated versions of the system carry controls preventing misuse,” Abhishek, principal researcher at Montreal AI Ethics Institute, said to TechCrunch via email.

Unstable Diffusion servers can accumulate a lot of problematic material in one place. This demonstrates both the abilities of AI systems to generate such content, and connects malicious users to each other to increase their’skills in creating such content.

Advertisement

NSFW discord servers: Montreal AI Ethics Institute

Unstable Diffusion also has a separate issue. Recent evidence of this is the reaction from the artist community to DeviantArt’s AI image generator, DreamUp.

This was trained using art uploaded to DeviantArt and without creators’ permission. Many artists are critical of AI systems that copy their style without proper credit or compensation.

Hollie Mengert, Greg Rutkowski and Greg Rutkowski are character designers whose fantasy landscapes and classical painting styles have been a popular prompt in Stable Diffusion.

They have deplored what they consider poor imitations of their characters that are still tied to them.

Concerns have been raised by them that AI-generated art mimicking their style will hinder their income, as more people use AI-generated images to make money. (Unstable Diffusion gives users full ownership over the images they create and permission to make them available for sale.

Advertisement

Gupta suggests another possibility. Artists who don’t want their work associated to porn could become collateral damage when users realize that certain artist’s names yield better results with Unstable Diffusion prompts. For example, “nude woman in the style [artist]”.

Chaudhry stated that Unstable Diffusion is seeking ways to make its models more equitable towards the artistic community and to “give back [to] artists and empower them.” However, he did not outline any specific steps like granting artists permission to exclude their work from training datasets.

NSFW discord servers: Artist impact

There is a market for adult artists who create, paint, and photograph suggestive work for a living. What will happen to human artists if AI can create the exact images they desire?

This is not an immediate threat. Adult art communities are grappling with the consequences of text-to image generators.

Advertisement

Finding a platform that can publish AI-generated porn outside the Unstable Diffusion Discord may prove difficult. FurAffinity, a furry art community, decided to ban AI generated art. Newgrounds hosts mature art with a content filter.

OnlyFans, one of the largest adult content hosts, suggested that AI art could be allowed on the platform. OnlyFans has a strict policy against deepfakes but allows content — possibly including AI-generated content — provided the creator is verified by OnlyFans.

NSFW discord servers: If the hosting is poor, then the question of hosting might not be relevant.

Milo Wissig, trans painter, said that AI-generated art is “not very good” to her. She has experimented with AIs depicting erotic art by trans and non-binary people.

It seems that it is best used as an artist’s tool. However, many people don’t know the difference and need something quick and inexpensive.

Advertisement

It’s easy to see where AI fails when artists work in kink. It’s difficult for AI to reproduce intricate tasks such as bondage. This is because tying knots and ropes is an art form.

Wissig stated to TechCrunch that it would be difficult for an AI to create a particular type of image for kinks. “It would be very difficult for the AI to make the ropes make sense,” Wissig said to

These AIs can amplify biases already present in traditional erotica, i.e. straight sex between white men is the norm.

Wissig stated that images are taken from mainstream porn. “You get the most hetero stuff the machine can think of, except if you tell it not.”

Advertisement

These biases are well documented in machine learning applications, such as facial recognition and photo editing.

The consequences of porn may not be so severe, but it is still horrifying to watch as an AI transforms ordinary people into racialized and gendered cartoons. Even AI models such as DALLE-2 have been criticised for creating art in European styles that is disproportionately high-quality.

Wissig attempted to use VQGAN last year to create images of “sexy, queer trans people”, he wrote in an Instagram posting. He added, “I had to carefully phrase my terms in order to get faces onto some of them.”

There is very little evidence that the AI can accurately represent transgender and genderqueer people in the Unstable Diffusion Discord. Nearly all the images generated by a channel called “genderqueer only” depict traditionally feminine women with penises.

Advertisement

Experimentation

Unstable Diffusion doesn’t only focus on in-house projects. Technically, Unstable Diffusion is a part Equilibrium AI, a company that Chaudhry founded.

The group also funds other efforts to create porn-generating AI system, including Waifu Fusion, an AI model that’s based on anime images.

Chaudhry envisions Unstable Diffusion growing into an organization that supports AI-powered content generation and sponsoring dev groups, as well as providing resources and tools to assist teams in building their own systems.

Equilibrium AI was awarded a place in an accelerator program by an unnamed “larger cloud compute provider”. This grant includes a “five-figure” grant in cloud hardware, compute, and Unstable Diffusion will use that money to expand its model training infrastructure.

Advertisement

Chaudhry states that Unstable Diffusion will also receive the grant and launch a Kickstarter campaign to seek venture funding.

He said, “We will create our own models and fine tune them to suit specialized use cases. We shall then spin them off into new brands or products.”

This group has a lot of work ahead of them. Moderation is the most important and immediate challenge Unstable Diffusion has to face.

There have been many examples of shocking failures in moderation of adult content. MindGeek, Pornhub’s parent company, lost support from major payment processors in 2020 after it was discovered that the site had been circulating child porn videos and sex-trafficking videos.

Advertisement

Is Unstable Diffusion likely to suffer the same fate as Diffusion? It is not clear at this time. However, at least one senator has called on AI companies to have stricter content filtering. This group is not on the right track.

Read also

Continue Reading