ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

The Verge Senior Reporter Victoria Song: Apple Siri Recap's Privacy Architecture Makes AI Harder to Use

After a two-week hands-on test of the Apple Watch's Siri Recap feature, The Verge reporter Victoria Song found that Apple's architectural choices to protect privacy—specifically, not training on user voice data, not attributing speaker identity, and not saving raw audio—made it harder for the AI to distinguish between conversation and media playback, or to determine what was personally important to the user. This ultimately led to frequent errors in summaries and a lack of practical value. She argues that better privacy often results in less useful AI products.

2026-11-19 21:00 GMT+8

After testing Siri Recap on the Apple Watch Ultra 4 for two weeks, The Verge senior reporter Victoria Song reached a conclusion: better privacy often means less practical AI products. Apple implemented several privacy-preserving designs for this ambient summarization tool—including not training on user voice, not saving raw audio, and omitting speaker attribution in summaries—but Song found that these choices directly impacted the AI's utility.

The most specific failures stemmed from the decision not to train on voice. Because Siri had not learned Song's vocal characteristics, it struggled to discern when she was actually speaking to someone versus when her phone was simply playing content aloud. When Song played a TikTok video aloud on her phone featuring a chronically ill creator recounting their trip to the emergency room due to sepsis, Siri Recap summarized the video as if Song herself, or someone she knew, had been sent to the ER. Another TikTok discussing an AITA (Am I The Asshole) Reddit thread about a woman named Dana attempting to seduce her best friend's husband was summarized as if Song herself were returning home with Dana's glitter at 2 or 3 AM. Song noted that Siri Recap automatically turns off when she wears AirPods, meaning she has to adjust her behavior to accommodate the AI's recognition flaws.

The second mechanism is the absence of speaker attribution in the summaries. Apple deliberately omits who said what and when in the recaps to prevent these records from being used as evidence in arguments, court cases, or for blackmail. However, stripping away attribution often causes the summaries to present other people's stories as the user's own experiences. Song also observed that Siri Recap heavily favors restating facts and statistics while ignoring information the user might find most valuable. In one interview, she found the guest's personal anecdotes and strong opinions about RFK Jr. to be the most interesting parts, but the summary only retained more concrete factual details.

Sign in / Sign up
ReadingResearchRadarInvestment framework

Song's final assessment is that while such ambient wearable devices are indeed useful in low-stakes, universally consensual simple scenarios, in the complex social environments of daily life, the social costs they impose—such as having to explain to everyone that your watch is recording, fielding follow-up questions about how privacy is handled, and weighing whether you have the energy to make ethical disclosures before every conversation—may outweigh the memory-aid benefits. She believes that better privacy often means less practical AI products; by choosing to limit what the AI knows about its users, Apple protects privacy but deprives the AI of the context needed to make correct judgments.

However, Song acknowledges that Siri Recap did help her in a few work-related scenarios, such as reviewing topics after product briefings and interviews, though the feature remains in beta. Her overall judgment is that this technology is not yet the answer for aiding memory or maintaining focus—whenever she forgets things, the negative consequences rarely change her life in irreversible ways; and whenever she isn't focused on the present moment, it is usually because she is looking at her phone.

Sources

  • theverge.comThe Verge↗
  • theverge.comThe Verge↗
Continue researching →