Meta Platforms took days to remove advertisements containing AI-generated child sexual abuse material (CSAM) on its Facebook and Instagram networks, according to a new investigation. The ads, which promoted applications capable of digitally altering images, included photos of real children, ranging from a European royal family member to social media influencers.
What Happened
The Tech Transparency Project (TTP), an independent research group, reported in an investigation published Tuesday that Meta failed to detect 332 ads containing CSAM this year. The majority of these advertisements promoted AI applications developed in China, with many specifically marketing "nudify" apps. These tools allow users to use artificial intelligence to digitally alter images of children, often removing clothing or changing context.
TTP matched multiple ads to photographs of real children available online. The investigation highlighted specific instances where static images were animated into sexually explicit videos. One ad used a press photo of a young member of a European royal family, animating her into a video performing a graphic sex act. Another ad took a photo of a 14-year-old Instagram influencer showing off her new sports club uniform and animated it into a video depicting oral sex. A third example involved a preteen girl posing in a pink athletic outfit with pigtails in a series of stock photos, which was morphed into a video where she appears frightened while being molested by an adult male.
Why It Matters
The presence of real children in AI-generated sexualized advertisements raises significant legal and ethical concerns. TTP notes that these ads appear to violate federal child pornography laws, citing the Justice Department's clarification that AI-generated CSAM is just as harmful as traditional CSAM. The incident underscores the challenges Meta faces in moderating AI-generated content on its platforms, particularly when third-party apps from China utilize real-world imagery without consent. The failure to detect these 332 ads highlights potential gaps in Meta's automated moderation systems regarding AI-generated sexual content involving minors.
The Bottom Line
Meta delayed the removal of hundreds of ads featuring AI-altered images of real children, including a royal and social media influencers. The Tech Transparency Project reports that the vast majority of these ads promoted Chinese AI apps, raising legal issues under federal child pornography laws that recognize AI-generated CSAM as harmful.