Skip to main content
technology Support = Good

Digital Safety for Vulnerable Users

Supporting means...

Protects at-risk users from digital harms; builds anti-stalkerware tools; supports domestic abuse survivors' digital safety; protects journalists and activists; provides security resources for vulnerable populations; fights spyware industry

Opposing means...

Builds or sells stalkerware/spyware; enables digital abuse; ignores safety needs of vulnerable users; sells surveillance tools to abusers; fails to address platform use for harassment or tracking

Recent Incidents

negligent

In December 2025, families of Levi Maciejewski (13, Pennsylvania, died 2024) and Murray Downey (16, Scotland, died 2023) sued Meta alleging Instagram's design enabled sextortion schemes targeting teens. The lawsuit cited an internal 2022 audit that allegedly found Instagram's 'Accounts You May Follow' feature recommended 1.4 million potentially inappropriate adults to teenage users in a single day. Instagram's default public privacy settings for teens were not changed to private until 2024, despite Meta claiming the change was made in 2021.

In November 2025, former partner Michelle Ritter filed a lawsuit against Eric Schmidt alleging sexual assault, physical abuse, and digital surveillance. The lawsuit claims Schmidt raped her on a yacht in November 2021 and at Burning Man 2023, photographed her without consent while nude, physically shoved her leaving bruises, and used a 'backdoor' to spy on employees. Ritter is seeking at least $100 million in damages. Schmidt's attorney called the claims 'false and defamatory' and part of a business dispute. The case follows a December 2024 domestic violence restraining order that was withdrawn after a financial settlement.

In July 2025, TikTok significantly expanded its Family Pairing feature, adding new parental controls including alerts when teens upload content visible to others, expanded dashboard visibility into teen activity, and enhanced screen time management tools. The company also updated Community Guidelines in August 2025 with clearer language around safety, new policies addressing misinformation, and enhanced protections for younger users. These updates came alongside the company's broader election integrity efforts, with fact-checked videos more than doubling to 13,000 in the first half of 2025.

$2.0B

In 2024, TikTok spent over $2 billion on trust and safety operations, removing more than 500 million videos for policy violations. Over 85% of violating content was identified and removed by automated systems, with 99% removed before any user reported it and over 90% removed before gaining any views. The company committed to investing another $2+ billion in trust and safety for the following year. TikTok also became the first platform to implement C2PA Content Credentials for identifying AI-generated content.

reactive

Amnesty International documented Serbian authorities using Cellebrite tools alongside spyware to target journalists and activists. A student activist's phone was hacked using a Cellebrite zero-day exploit (CVE-2024-53104) affecting millions of Android devices. Cellebrite only suspended sales to Serbia's security services in February 2025 after the public Amnesty report—despite ongoing abuse documented since 2024.

Uber launched industry-first women rider preference feature on November 29, 2024 in India, expanded to six US cities (Baltimore, Minneapolis, Philadelphia, Seattle, Portland, Washington DC) on October 17, 2025. Feature gives women drivers option to receive trip requests exclusively from women riders, especially helpful during late hours. Used on more than 150 million trips globally, with quarter of women drivers turning it on at least once a week and more than half keeping it on for over 90% of their trips. Feature enables over 21,000 trips in India alone. Aims to improve safety and comfort for both female drivers and riders.

compelled

In the Meta/WhatsApp lawsuit against NSO Group, a U.S. federal court found NSO liable for violating the Computer Fraud and Abuse Act by accessing WhatsApp servers to install Pegasus spyware on over 1,400 devices in 2019. In May 2025, the court ordered NSO to pay $167 million in damages. During the lawsuit proceedings, court documents revealed Saudi Arabia as one of NSO's Pegasus customers. Evidence showed the spyware was used against Princess Haya of Dubai and associates of murdered journalist Jamal Khashoggi. NSO admitted it had cut off 10 government customers for abusing Pegasus.

Following successful regional pilot in 9 cities (Seattle, Detroit, Jacksonville, Houston, Atlanta, Phoenix, Chicago, Denver, Miami) starting August 2024, Lyft rolled out rider verification nationwide in November 2024. System cross-checks rider's legal name and phone number using trusted third-party databases. If information can't be validated, riders asked to upload government-issued ID. Verified riders receive verification badge on profile. Drivers see rider's name, verification badge, rating, and photo before accepting ride, providing greater peace of mind and helping confirm riders are who they say they are. Verifying millions of riders to enhance driver safety.

Uber introduced multiple accessibility features on October 10, 2024: (1) Self-identification for blind/low-vision riders allowing them to disclose disability status and communication preferences to drivers after trip acceptance; (2) Self-identification for deaf/hard-of-hearing riders with chat/phone preference options that prevent unwanted calls when chat-only selected; (3) Mandatory service animal education video sent to all US drivers, designed with blind and service animal advocacy organizations, covering service animal rights and reminder that denying rides violates Uber policy and federal law; (4) Pilot program for voluntary service animal advance notification in US and Canada. Features aim to improve accessibility and reduce discrimination, though launched after company received over 21,000 service animal complaints and faced October 2024 protests.

Uber launched nationwide rider verification system on September 18, 2024, allowing drivers to see 'Verified' badge for riders who underwent additional verification steps. System reviews rider account details such as names and phone numbers and cross-references them with trusted third-party databases. Majority of riders are verified automatically without additional action. Riders can also upload government-issued identification along with selfie for verification. Feature aims to improve driver safety and confidence in accepting trip requests. Announced at 'Only on Uber' event in Washington, DC.

Uber expanded 'Record My Ride' feature to drivers in all 50 states on September 18, 2024, following successful pilot program. Feature allows drivers to use front-facing camera on their smartphone to record video and audio during trips without need to invest in separate dashcam. Every recording is encrypted and stored directly on drivers' devices - nobody including Uber, riders, or other drivers can access recordings unless driver chooses to send it in for review. Feature provides drivers with evidence protection tool in case of disputes or safety incidents while protecting rider privacy through encryption and local-only storage.

negligent

In 2024-2025, the Department of Homeland Security warned that young people were being radicalized in Discord servers. A DHS memo noted the average age of members in extremist Discord channels was 15. An Iowa school shooter in 2024 had warned on Discord he was 'gearing up' before killing two people. Since August 2023, three US plots involving juveniles sharing Islamic State messaging in private Discord chats were disrupted. The ADL found Discord's content moderation for private groups was primarily reactive, depending on user reports rather than proactive filtering.

negligent

Relatives of over 60 young people who died from fentanyl overdoses sued Snap Inc., alleging Snapchat's disappearing messages feature facilitated illegal drug trade targeting minors. Victims included Cooper Root (16, Texas), Donevan Hester (16, Washington), and Nicholas Cruz Burris (15, Kansas). In January 2024, Los Angeles Superior Court Judge Lawrence Riff allowed the lawsuit to proceed, overruling Snap's objections to 12 claims including negligence, defective product, and wrongful death. Internal Snap emails cited in court noted the company received approximately 10,000 sextortion reports per month, described as 'only a fraction of the total abuse.'

Discord launched Teen Safety Assist in 2023, introducing safety alerts for first-time DMs, content filters to blur sensitive media, and a warning system designed to educate rather than punish teen users. The features were developed in collaboration with child safety organization Thorn. In 2025, Discord announced its founding role in ROOST (Robust Open Online Safety Tools), a cross-industry nonprofit offering free open-source tools to detect, review, and report CSAM. Discord's Chief Legal Officer serves as ROOST board chair, and the company contributed funding, technology, and employee expertise.

In September 2023, Snap introduced new safety features for 13-17 year olds including stronger friending protections requiring mutual connections, in-app warnings when teens receive messages from blocked/reported users or users from unexpected regions, location-sharing reminders, and expanded parental controls via Family Center. Snap also launched Safety Snapshot episodes on sextortion and grooming reviewed by NCMEC, and reported that Trust and Safety teams had more than doubled since 2020.

Lyft launched Women+ Connect in September 2023, offering women and nonbinary drivers option to prioritize matches with nearby women and nonbinary riders. Feature tested in 50+ markets before nationwide rollout in March 2024. By March 2024, powered more than 10 million rides. Over 7 million eligible riders turned on feature. Over half of eligible women and nonbinary drivers opted in. As of July 2024, signed-up drivers matched with women and nonbinary riders about 66% of time, up from around 50% at launch. Designed in partnership with It's On Us sexual assault prevention campaign, National Association of Women Law Enforcement Executives, and National Sheriff's Association Traffic Safety Committee. Industry-leading safety feature addressing real safety concerns for women and nonbinary community members.

negligent

An NBC News investigation in June 2023 found that at least 35 child abduction, grooming, or exploitation prosecutions and 165 CSAM prosecutions involved Discord communications. Hundreds of active servers promoting child exploitation were identified. The FBI subsequently warned in September 2023 that violent online groups were deliberately targeting minors aged 8-17 on messaging platforms including Discord to extort them into producing CSAM, with LGBTQ+ youth and racial minorities particularly targeted.

negligent $30.8M

In May 2023, the FTC charged Amazon with violating children's privacy law (COPPA) by retaining kids' Alexa voice recordings indefinitely and undermining parental deletion requests ($25M fine). Separately, Ring was fined $5.8M after an employee viewed thousands of videos from 81+ female users' cameras in intimate spaces. Ring's security failures from 2016-2020 also enabled hackers to access consumer accounts and cameras.

reactive

In April 2023, Citizen Lab and Microsoft published research identifying at least five civil society victims of QuaDream's REIGN spyware across North America, Central Asia, Southeast Asia, Europe, and the Middle East. Victims included journalists, political opposition figures, and an NGO worker. The spyware exploited a zero-click iOS vulnerability. Five days after the exposé, QuaDream shut down after failing to receive Israeli Defense Ministry authorization to sell to new clients. The company fired all employees. The closure followed Israel blocking a potential sale to Morocco.

negligent

Despite Musk declaring child safety his 'top priority' after acquiring Twitter, independent investigations found the situation worsened. X disbanded its Trust and Safety Council (which included 12 groups advising on child exploitation), and nonprofit Thorn terminated its contract with X after the company stopped paying invoices. A February 2023 NYT investigation found CSAM was easy to find and X was slower to action reports. NBC News found in 2025 that automated accounts were flooding hashtags with child exploitation content using the same methods identified in 2023, indicating persistent failure to address the problem.