Signal

A week with Apple Watch's Siri Recap and Live Rewind in beta: inaccurate summaries lag Amazon Bee, Granola, and Otter, and rarely justify the privacy trade-offs

First reported by Bloomberg ·

The signal ●●●○ Compiled by AI from Bloomberg, Techmeme, Wired and CNET
Why you might care

Your watch can now passively record snippets of your conversations, changing how you recall information.

What happened

Apple is beta testing two new 'Audio Intelligence' features for its latest Apple Watch models: Live Rewind and Siri Recap. Live Rewind allows users to replay the last 15 seconds of a conversation on their watch. Siri Recap, also in beta, can generate summaries of daily conversations when granted permission to listen. Both features are opt-in, require recent Apple hardware and iOS versions, and are initially limited to English for users 18 and older. Apple emphasizes on-device processing for Live Rewind and privacy-preserving cloud compute for Recaps, with data being end-to-end encrypted if synced with iCloud. Despite these privacy measures, including warnings and data deletion policies, user experience reviews indicate that Live Rewind can be inaccurate in noisy environments and socially awkward, while Siri Recap, though less prone to recording irrelevant media than some competitors, provides only basic memory joggers rather than detailed meeting notes.

What it means

Apple's new on-device and cloud-based audio intelligence features, while aiming for privacy with opt-in settings and limited data retention, introduce a new paradigm for wearable ambient computing. The core challenge remains balancing functionality with user and bystander privacy, a concern echoed by digital rights advocates. Apple's approach, processing audio on-device for Live Rewind and using secure cloud compute for Recaps, attempts to mitigate these issues, but the very nature of ambient listening on a personal device poses novel privacy questions that may necessitate future regulatory or societal adaptation.

The practical utility of Apple's beta features is currently limited, with Live Rewind struggling in noisy environments and Siri Recap offering basic memory prompts rather than comprehensive meeting summaries. This positions Apple's offering as a supplementary tool rather than a replacement for dedicated AI notetakers, despite its convenience. Competitors like Amazon Bee AI are also grappling with similar issues, such as accurately identifying relevant conversations versus background media, suggesting that on-device AI's ability to discern context and provide meaningful, accurate summaries remains an ongoing technological hurdle.

AI-written summary. May contain errors.

Apple Amazon