San Francisco Targets Apple and Google Over AI ‘Nudify’ Apps in Test of Deepfake Liability

San Francisco Targets Apple and Google Over AI ‘Nudify’ Apps in Test of Deepfake Liability
San Francisco has moved to force Apple and Google into the front lines of the deepfake porn fight, accusing the tech giants of helping an abusive AI industry thrive while hiding behind their app stores’ policies.

Early warnings and growing concern

California criminalized knowingly facilitating non‑consensual deepfake pornography and, in 2025, gave victims power to sue third‑party facilitators. Despite those laws, watchdogs repeatedly warned Apple and Google through 2024 and early 2025 that “dozens of apps” in their stores were selling non‑consensual intimate images in exchange for payments processed by the companies.

By mid‑2025, reports alleged the app stores were “key participants in the spread of AI tools that can turn real people into sexualized images,” steering users toward such apps while collecting fees.

Cease‑and‑desist letters land

This week, San Francisco City Attorney David Chiu sent formal cease‑and‑desist letters ordering Apple and Google to purge 13 AI “nudify” apps that generate nude images of people without consent. He warned the stores were violating “California’s laws that prohibit services that create deepfake pornography” and said his office was “absolutely horrified” by how ubiquitous the technology has become, overwhelmingly targeting women and children.

“These images are used to bully, humiliate, and threaten women and girls,” Chiu said, describing impacts on reputation, mental health, and autonomy, with some victims becoming suicidal. He alleged Apple and Google have likely “made millions of dollars in fees” from the apps.

Tech giants’ response and next steps

Google says it has already suspended the five Android apps cited, insisting that “Google Play does not allow apps that contain sexual content” and that it “continually take[s] proactive steps to detect and remove apps with harmful content.” Apple has indicated to reporters it is taking action, while both firms face a 28‑day deadline before potential civil penalties.

The confrontation now tests whether major platforms can be held legally responsible not just for content, but for the AI tools and business models that enable it.

Continue reading https://foxvector.com/stories/019f837b-8078-1ac4-70f5-26cc20612c2f