SF Attorney Orders Apple and Google to Pull AI Nudify Apps

San Francisco’s City Attorney has issued cease-and-desist letters to Apple and Google, demanding they pull 13 AI-powered “nudify” apps from their app stores. These apps use AI to create fake nude images of real individuals without their consent. Legal advocates argue this practice poses serious risks, particularly for women and minors.

What Are These Apps, Exactly?

The 13 apps mentioned in the letters often market themselves as “face-swap” or photo-editing tools. However, their main purpose is to generate nonconsensual intimate images (NCII) — essentially, realistic-looking nude photos of people who never agreed to be depicted that way. It’s similar to deepfake technology, but specifically targets stripping clothing from real individuals’ photos using AI image generation.

As reported by Wired and cited by MacRumors, the San Francisco City Attorney’s office has identified these apps as available on both the Apple App Store and Google Play Store. These two platforms dominate the digital marketplace for smartphone apps. The cease-and-desist letters are formal legal demands that require the companies to take action to avoid potential legal consequences.

Why This Is a Big Deal for Apple and Google

Apple and Google have strict developer policies that ban apps that facilitate harassment or generate harmful content. The cease-and-desist letters point out that the companies aren’t enforcing their own rules. By hosting these apps, they enable widespread harm.

App stores act like digital shopping malls. The mall owner—in this case, Apple or Google—sets the rules for what stores can operate inside. Critics have long claimed both companies enforce these rules inconsistently, allowing problematic apps to slip through or remain available long after complaints arise.

By sending these letters, the City Attorney increases pressure on both companies to take action. While cease-and-desist letters are demands rather than court orders, failing to address them could lead to litigation.

The Broader Fight Against AI-Generated Abuse

This action reflects a growing legal and legislative effort against nonconsensual AI imagery. The harm these apps cause is real and well-documented. Victims, many of whom are teenagers, report severe psychological distress, damaged reputations, and even targeted harassment campaigns after fake intimate images of them circulate online.

Several U.S. states have already enacted laws that criminalize the creation or distribution of NCII. At the federal level, lawmakers are pushing for bills to address deepfake abuse, although no comprehensive federal law has passed Congress yet. The letters from the San Francisco City Attorney take a different approach: targeting the platforms distributing these harmful tools instead of just the individuals misusing them.

What This Means for Everyday Users

If you use the Apple App Store or Google Play, this situation serves as a reminder that not everything available for download is safe or legal. While these apps may seem like fun photo editors, generating fake intimate images of someone without their consent is illegal in many places and can lead to criminal charges.

This is especially important for parents to consider. These apps are accessible to anyone with a smartphone. Schools across the country have already faced incidents where students used nudify apps to target classmates. Being aware of what apps your kids download is crucial.

If Apple and Google decide to comply with these demands, you might notice these 13 apps disappearing from search results in both stores. This would be similar to how both companies have previously removed apps that violated content policies when faced with public or legal pressure.

Community Reaction

“These apps should have never been allowed in the first place. What exactly are the App Store review teams doing?”

— u/techpolicywatcher, Reddit

“Good. The stores profit from every download. They have a responsibility. This should have happened two years ago.”

— YouTube commenter on MacRumors coverage

What To Watch

• Apple and Google’s response: Neither company has publicly responded to the cease-and-desist letters as of now. Keep an eye out for official statements or quiet app removals in the coming days.
• Potential litigation: If either company chooses not to act, the City Attorney’s office might file a lawsuit, likely drawing national attention and further regulatory scrutiny.
• Federal legislation: Congress has various bills aimed at addressing AI-generated abuse imagery in different stages of review. A high-profile case like this could speed up that process.
• Other jurisdictions: If San Francisco’s approach gains traction, expect other city or state attorneys general to send similar demands to both companies, especially in states that have already criminalized NCII.

Sources: Engadget | MacRumors | Wired