Addressing the Misuse of Technology Against Domestic Violence Survivors
As a dedicated advocate for survivors of domestic violence, I have observed that while technology evolves, the pattern of violence remains constant. Abusers continually seek new methods to harm. In the 1980s, Polaroid cameras presented a new avenue for abusers to capture exploitation without a photo lab’s involvement. During the 1990s, Caller ID facilitated stalkers in tracking phone numbers, making it easier to locate those trying to escape. By the 2010s, smart technology, including doorbell cameras and location surveillance apps, provided further tools for abusers to monitor and control their victims.
Currently, a worrying trend has emerged with the rise of ‘nudify’ and ‘kissing’ apps on the internet. These applications employ AI to create fake nude or intimate images without consent, rapidly permeating the internet. Distributing or sharing such images without permission is not only unethical but often illegal. This trend disproportionately affects women and girls. To combat this, I collaborate with safety teams to prevent these apps and their promotion from appearing on online platforms.
AI enhances our ability to detect disguised malicious content, including ads that use emojis and coded language. Despite these efforts, it’s crucial for tech companies to enhance prevention and reporting tools for survivors. They should also partner with other firms and nonprofits, and support law enforcement in holding perpetrators accountable. This requires ongoing work, not merely one-off solutions.
The tech industry is actively searching for methods to identify and dismantle this harmful content. Yet, behind every malicious site, determined bad actors seek methods to exploit gaps in defenses.
Since the internet transcends borders and malicious content proliferates across platforms, responses must extend to multiple arenas. Collaboration among tech companies, nonprofit groups, and civil organizations is vital for preventing harm and aiding survivors. Initiatives like the Tech Coalition’s Lantern program allow companies to share URLs of violating apps and websites, facilitating investigations and actions against them. Such collaboration is essential to stop the redistribution of nonconsensual images on the web.
Building awareness of protective tools is equally important. Every survivor and at-risk individual should know protective options are available. By using services like StopNCII.org, they can report intimate images shared without consent. Supporting bipartisan legislation, such as the Take It Down Act, has aided many companies in creating more supportive tools for victims.
Part of the solution involves legal action against entities that develop and promote these apps. Meta has filed a lawsuit against Joy Timeline HK Limited, the creators of CrushAI apps, over attempts to advertise apps generating AI-produced nude images without consent. A court hearing recently took place to decide future proceedings. Over the year, numerous cease and desist notices have been issued to companies advertising such apps, including Undressly and Crushlove.
Twenty-six years ago, I initiated the Safety Net Technology Project to curb the misuse of technology by abusers. After years in the nonprofit sector fighting gender-based violence, I transitioned to tech where intimate image abuse is treated as a priority. While not flawless, persistence remains essential.
We can collectively dismantle exploitation tactics and empower survivors. If someone threatens to share intimate images online, visit StopNCII.org or TakeItDown.NCMEC.org for assistance.
Cindy Southworth is the Head of Women’s Safety at Meta and former Executive Vice President of the National Network to End Domestic Violence. The views presented here are her own.