How the misuse of AI can affect your business.
Popular text-based image generation platform Civitai is forced to look for a new cloud computing provider after OctoML, its current partner, decided to end its business relationship.
The reason was the journalistic investigation of the publication 404 Media, which found multiple cases of generating potentially illegal content by Civitai users, including images of a sexual nature with the participation of minors. In response, OctoML unilaterally introduced a strict content filter for Civitai, completely blocking the ability to generate explicit and pornographic images.
The company commented: "We [OctoML] have decided to terminate our business relationship with Civitai. This decision is consistent with our commitment to ensuring the safe and responsible use of AI."
After entering filtering, attempts to generate questionable or explicit images began to end with the message "OctoML blocked". Representatives of Civitai recommended that users complain directly to OctoML if they consider the blocking unjustified. However, the company remained adamant.
Civitai, in turn, has introduced its own content moderation methods. In particular, we have blocked requests that combine the names of celebrities with explicit terms. A system for automatic correction of potentially dangerous content has also been launched, which makes it as difficult or impossible as possible to generate images with the participation of minors in a sexual context.
However, this was not enough to continue cooperation with OctoML - the company decided to completely abandon the provision of its computing power to serve the requests of Civitai users.
Civitai, which raised a $ 5.1 million investment from Silicon Valley venture capital firm Andreessen Horowitz, is now looking for a new partner to handle requests previously handled by OctoML. The company promises to restore full functionality of its service in the near future.
Earlier, the online platform Civitai introduced a new feature that allows platform participants to publish rewarded requests for other users.
Popular text-based image generation platform Civitai is forced to look for a new cloud computing provider after OctoML, its current partner, decided to end its business relationship.
The reason was the journalistic investigation of the publication 404 Media, which found multiple cases of generating potentially illegal content by Civitai users, including images of a sexual nature with the participation of minors. In response, OctoML unilaterally introduced a strict content filter for Civitai, completely blocking the ability to generate explicit and pornographic images.
The company commented: "We [OctoML] have decided to terminate our business relationship with Civitai. This decision is consistent with our commitment to ensuring the safe and responsible use of AI."
After entering filtering, attempts to generate questionable or explicit images began to end with the message "OctoML blocked". Representatives of Civitai recommended that users complain directly to OctoML if they consider the blocking unjustified. However, the company remained adamant.
Civitai, in turn, has introduced its own content moderation methods. In particular, we have blocked requests that combine the names of celebrities with explicit terms. A system for automatic correction of potentially dangerous content has also been launched, which makes it as difficult or impossible as possible to generate images with the participation of minors in a sexual context.
However, this was not enough to continue cooperation with OctoML - the company decided to completely abandon the provision of its computing power to serve the requests of Civitai users.
Civitai, which raised a $ 5.1 million investment from Silicon Valley venture capital firm Andreessen Horowitz, is now looking for a new partner to handle requests previously handled by OctoML. The company promises to restore full functionality of its service in the near future.
Earlier, the online platform Civitai introduced a new feature that allows platform participants to publish rewarded requests for other users.
