As a dedicated advocate for survivors of domestic violence, I have witnessed the evolution of technology, and yet the cycle of violence remains constant. Abusers perpetually seek new methods to inflict harm.
In the 1980s, Polaroid cameras allowed abusers to document exploitation privately. By the 1990s, Caller ID enabled stalkers to trace phone numbers and locate individuals attempting to evade them. The 2010s brought smart technology, such as doorbell cameras and location surveillance apps, which provided abusers with new tools for tracking and controlling their victims.
Recently, another concerning development has emerged: an increase in the use of so-called “nudify” and “kissing” apps online. These applications employ artificial intelligence to create fake nude or intimate images of individuals without their consent. The rapid spread of these tools across the internet is alarming.
Sharing someone’s real or fake intimate photos without permission is not only unethical but often illegal. The consequences can be devastating, with women and girls being disproportionately affected. To combat this trend, I collaborate with safety teams to remove such apps, related ads, and the individuals behind them from online platforms.
AI assists these teams in improving signal reviews, including ad text and landing pages, to identify content disguised with emojis, coded language, or seemingly benign photo-editing apps.
Tech companies must enhance prevention and reporting tools for survivors, collaborate with other companies and nonprofits, and support law enforcement in holding criminals accountable. This is not a one-time solution. The industry continuously seeks new methods to identify and eliminate this content.
Behind every malicious website producing nudify content are teams of persistent bad actors. They exploit loopholes and adapt tactics as defenses strengthen. With the borderless nature of the internet, a single-platform response is insufficient.
Ongoing collaboration among tech companies, nonprofit organizations, and civil society groups is critical for preventing harm and aiding survivors. Initiatives like the Tech Coalition’s Lantern program enable companies to share URLs of violating apps and websites, facilitating investigations and appropriate actions.
While collaboration is vital, ensuring people are aware of protective tools is the most crucial element. Survivors and potential victims need to know that they can regain control. By creating a case on StopNCII.org, they can safely report unauthorized sharing of intimate images.
Bipartisan legislation such as the Take It Down Act is crucial. Many companies leverage this to develop supportive measures for victims and offer more tools to report nonconsensual content.
These measures are part of supporting survivors and victims. Another essential aspect is taking legal action against those promoting or creating this content. Nearly a year ago, Meta initiated a lawsuit against Joy Timeline HK Limited, the entity behind CrushAI apps, for attempting to advertise apps creating AI-generated nude images without permission. A court hearing for the case recently occurred to discuss forthcoming steps.
Over the past year, Meta issued numerous cease and desist letters to other companies and developers worldwide for promoting nudify apps, including Undressly and Crushlove.
Twenty-six years ago, I founded the Safety Net Technology Project to prevent the misuse of technology by abusers. After years combatting gender-based violence within nonprofits, I joined the tech sector because the current team prioritizes intimate image abuse as a core policy issue.
This endeavor is challenging, but perseverance is vital. Collective action can dismantle those who exploit others, empowering survivors.
If someone threatens to share your intimate images online, visit StopNCII.org or TakeItDown.NCMEC.org.
Cindy Southworth is Head of Women’s Safety at Meta and former Executive Vice President of the National Network to End Domestic Violence. The views expressed in this article are her own.