Meta Platforms, the parent company of Facebook, continued to host advertisements containing AI-generated child sexual abuse material (CSAM) for weeks after Indian authorities began investigating the issue. This situation highlights ongoing challenges for large tech companies in policing harmful content on their platforms, particularly content created or amplified by artificial intelligence.
The investigation by Indian regulators into Meta’s role in allowing AI-generated CSAM ads to circulate underscores increasing scrutiny of digital platforms’ responsibility to detect and remove illegal content promptly. AI-generated content introduces new complexities for content moderation because it can be novel, rapidly produced, and less recognizable by traditional detection tools.
Despite Meta's existing content policies and automated moderation systems, reports indicate that the company did not fully halt these AI-generated CSAM ads during the early weeks of the investigation. This delay raises concerns about the effectiveness of current AI content filters and the company's prioritization of user safety in the Indian market.
The impact of such ads can be severe, harming vulnerable children and undermining public trust in social media platforms. Advertisers and users increasingly demand safer digital environments free of exploitative and illegal materials. Governments, including India’s, are pushing for stricter regulations and enforcement to curb the spread of harmful content online.
Moving forward, Meta faces pressure to improve AI detection mechanisms, enhance human oversight, and cooperate transparently with regulators. The case in India also signals a broader need for global standards addressing AI-generated harmful content. How companies respond will shape the safety and trustworthiness of online platforms worldwide.