Apple and Google Ordered to Purge 'Nudify' Apps from App Stores
In letters sent to Apple and Google, San Francisco City Attorney David Chiu said that both companies have long been aware that they are hosting apps in violation of state law.
The city of San Francisco has issued a formal order to Apple and Google, demanding the immediate removal of dozens of "nudify" apps from their respective app marketplaces. These programs, which use artificial intelligence to digitally strip clothing from uploaded photos, are facing a legal crackdown under California state regulations designed to combat non-consensual deepfake pornography.
⚖️ Legal Underpinnings and Financial Profits
California has enacted strict laws making it a criminal offense to "knowingly facilitate" or "recklessly aid and abet" the creation of non-consensual deepfake pornography.
Key aspects of the city's legal action include:
- Civil Action Potential: State laws allow victims to sue third-party platforms that facilitate and distribute deepfake pornography.
- Warned Repeatedly: San Francisco City Attorney David Chiu pointed out that Apple and Google have been warned multiple times since January by the Tech Transparency Project (TTP).
- Profiting from Harm: Chiu estimated that both tech conglomerates have likely pocketed millions of dollars in transaction fees by hosting and processing payments for these apps.
[Developer Uploads Nudify App] -> [App Store Hosting / Payments] -> [AI Deepfakes Generated]
|
(San Francisco Orders Purge / Legal Warnings)
🕵️ The Role of App Store Steering
The Tech Transparency Project's reports highlighted a concerning discovery: search algorithms in both the Apple App Store and Google Play Store were actively steering users toward these AI nudify apps when they searched for generic photo editing tools. Both tech companies cut ties with some individual apps after public pressure, but the city attorney's letters emphasize that a reactive approach is not enough. The firms are expected to proactively police their stores to prevent sexual abuse and exploitation.
🔮 The Road Ahead for Digital Safety
San Francisco has given Apple and Google 28 days to respond and detail their compliance plans. Failure to take decisive action could expose the companies to heavy civil penalties under California's third-party facilitator laws. This case marks a critical turning point in platform liability, showing that municipalities are willing to hold app store operators legally and financially responsible for the outputs of the generative AI tools they distribute and monetize.
🔗 Reference
- Original Article: Read the full story on TechCrunch
