Outrage as trapped in x caught in digital sexual abuse scandal

A disturbing trend has occurred on X (formerly Twitter), in which users take advantage of artificial intelligence to generate manipulated images of women that “take off” them digitally.

The trend has triggered a widespread condemnation, not only because of the obvious violation of the rights and dignity of women, but also for the detection of important ethical and regulatory gaps in generative AI technology.

The abused tool is Grok, a AI chat bot and an image generation model of X.

GROK was originally developed for creative and informative tasks and is now used to take off women in photos.

“We are fighting femicides, rape culture and now we have to fight AI because men ask Grok to take off women for fun,” wrote @M_uthoni (nyarari) about X.

Critics say these ai-generated pictures are a new form of digital sexual violence. While some compare it to deep pornography, many argue that this is even more dangerous due to the accessibility and speed of AI tools, which are lacking adequate protective measures.

The Kenyan user Nyandia Gachago repeated these concerns: “This is not just” deep porn “. This is sexual violence.

The controversy has also raised legal questions.

“Can we use the computer and cyber criminal measures to sue someone if they are tempted to move them off? Because that is beyond hell,” asked @shad_khalif.

Others pointed out the responsibility of the user. “Knife do not kill people … people use knives. Guilt to the users, not the tool,” wrote @f_akumu.

The lightness with the GROK allegedly performs such harmful requests has caused many to question the robustness of its security mechanisms.

The counter -reaction increased after the South African user Phumzile van Damme Grok publicly confronted. She shared screenshots of an invitation and a manipulated picture of @lindelwamabuya, whose photo had been changed to uncover her breasts.

Van Damme called for transparency: “This shows a serious gap in her internal protective measures,” she wrote. “@Lindelwamabuya deserves a direct apology, and users deserve transparency about which improvements are implemented at the system level to ensure that this never happens again.”

GROK later spent a public apology and recognized his failures.

“We sincerely apologize at @lindelwamabuya for the need that is caused by the inappropriate change of your picture,” said Grok. “This incident illuminates a gap in our protective measures. We are actively working to improve our security mechanisms, including better immediate filtering and amplification learning.”

Despite the apology, many users are not convinced.

“Man, this app raves about degenerates. There are people who use GROK to touch pictures of women here. Why can TF do that at all?” Asked the Kenyan user @tiskusk.