Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features
Summary
- An investigation revealed an extensive network of over 400 connected domains and apps masquerading as mundane services like pet portrait generators.
- These apps stealthily load hidden web interfaces that enable users to generate sexually abusive deepfake images and videos using uploaded photos.
- Researchers found the operation, allegedly linked to Chinese developers and a Hong Kong entity called KeLing Technology, utilized bait-and-switch tactics to pass app store reviews.
- Ads promoting these apps—including explicit content depicting minors—were widely distributed on Meta platforms, prompting swift removal actions by Apple, Google, and Meta after media inquiries.
Why it matters
This case highlights major safety and moderation vulnerabilities across major app stores and social media platforms, where malicious actors easily bypass review pipelines to distribute harmful deepfake generation tools.