Instagram’s AI Deepfake Tool Collides With Consent Backlash and Vanishes in Three Days

Meta launched and quickly removed a new AI feature, Muse Image, which allowed users to generate images by referencing public Instagram accounts. The tool faced immediate backlash from users, privacy advocates, and talent unions over concerns about consent and the potential for creating deepfakes.
Instagram’s AI Deepfake Tool Collides With Consent Backlash and Vanishes in Three Days

Instagram’s AI Deepfake Tool Collides With Consent Backlash and Vanishes in Three Days
Meta’s attempt to make Instagram more “creative” with AI instead ignited a fast-moving privacy and consent firestorm that forced the company to kill a flagship feature in just three days.

Launch: An ambitious new AI model

On Tuesday, Meta unveiled Muse Image, the first image-generation model from its Superintelligence Labs, promising an “agentic” system that could reason over prompts and power image tools across Instagram, WhatsApp, and other apps. A key capability let users @‑mention any adult public Instagram account so Meta’s AI could “use public photos to build a visual,” effectively pulling other people into AI-generated scenes without notifying them.

As the model rolled out, Meta leaders were simultaneously touting the broader Muse / Muse Spark stack as a powerful and low-cost platform for developers on the new Meta Model API.

Immediate backlash: Consent, deepfakes, and opt-out anger

Within hours, journalists and advocates began flagging that anyone with a public profile could be turned into AI content without explicit consent, with only a buried settings toggle to opt out. Guides urged Instagram users to dig into “sharing and reuse” settings to stop others from using their posts, Reels, and audio in Meta’s AI tools.

Privacy group Public Citizen called the approach an “egregious invasion” of privacy and accused Meta of choosing “the creepiest possible path,” warning that people shouldn’t wake up to find their faces used as “raw material for someone else’s AI experiment.”

Experts on online abuse said the design “obviously erode[s] our rights to our own likeness” and creates “an obvious tool for #sextortion and other scammers,” criticizing Meta for pursuing “high-risk design” while forcing individuals “to jump through hoops to opt out.”

Unions and talent agencies push back

Entertainment unions quickly mobilized. SAG-AFTRA urged its roughly 160,000 members to opt out, arguing that “anything other than a clear and conspicuous OPT-IN” for using users’ images was “unacceptable” and out of step with public concern over “nonconsensual digital replicas.” The union later applauded Meta’s reversal, calling the feature “unwise” and saying discontinuing it was “the responsible thing to do.”

Talent powerhouse Creative Artists Agency (CAA) pressed for a shift to affirmative consent, insisting that “no one’s name, image, likeness, voice, or creative work should be used by any third party, including AI models, without clear, documented consent,” and that artists must be able to set their own terms and restrictions.

Meta retreats: “Missed the mark”

By Thursday, how‑to‑opt‑out explainers were spreading across tech media, underscoring that users were neither told when their images were reused nor shielded from harassment and impersonation risks.

On Friday, under mounting criticism from privacy advocates, users, and talent agencies including CAA, Meta announced it was switching off the @‑mention feature entirely. The company said its “intent was to provide a useful creative tool and to give people control over whether their public content could be referenced in this way,” but conceded that the feature had “missed the mark” and “is no longer available.” Other Muse Image editing tools remain online.

The episode has become a vivid example of a larger AI-era fault line: whether companies can treat publicly shared images as default training and generation fodder, or must first secure explicit, opt‑in consent.

Continue reading https://foxvector.com/stories/019f6801-edd4-25f7-735d-13b1d6ffa76d

Write a comment