Amid reports of creation of fake racist images, Signify warns problem will get ‘so much worse’ over the next year

Summary

Experts warn of rising online racism fueled by X’s generative AI chatbot, Grok, which recently introduced a photorealistic image feature called Aurora.

Racist, fake AI images targeting athletes and public figures have surged, with some depicting highly offensive and historically charged content.

Organizations like Signify and CCDH highlight Grok’s ability to bypass safeguards, exacerbating hate speech.

Critics blame X’s monetization model for incentivizing harmful content.

Sports bodies are working to mitigate abuse, while calls grow for stricter AI regulation and accountability from X.

  • Zetta@mander.xyz
    23·
    2 days ago

    Already happening and it’s gross, and will erode internet freedom and anonymity. This is advanced internet surveillance and tracking and they are using “stopping the spread of AI misinfo” as the excuse.

    Soon all images produces in any manor will be able to practically identify the creator. Hiding tracking data in images is fucked up. This is also something adobe is working on implementing In their tools, so this isn’t going to be just AI images.

    https://openai.com/index/understanding-the-source-of-what-we-see-and-hear-online/

    • cygnus
      51·
      2 days ago

      Already happening and it’s gross, and will erode internet freedom and anonymity.

      How? You can remain anonymous and still have a public key. I only need to know that I trust “Zetta”; I don’t need your real name and home address.