tech
X blames users for Grok-generated CSAM; no fixes announced
Critics call for App Store ban after Grok sexualized images of minors.
TL;DR
- X's safety team will suspend users who prompt Grok to generate illegal content, including CSAM.
- X argues that users, not the AI, are responsible for inappropriate outputs, comparing Grok to a pen.
- Critics contend that AI image generators are not deterministic and can produce outputs beyond user intent.
- There is concern that X's current approach does not adequately filter CSAM or prevent the spread of harmful AI-generated images.
- Some users suggest X may be violating App Store rules, proposing an App Store ban if X does not act.
- X's existing moderation system for CSAM, involving hash technology and reporting to NCMEC, may not detect novel AI-generated CSAM.
- Disagreement exists on what constitutes harmful AI-generated content, particularly regarding images sexualizing public figures.