Here’s what it’s like to use Audio Intelligence on the Apple Watch

Your Apple Watch can now passively record and summarize your conversations, provided you opt in and have the latest hardware.

Apple has released a developer beta for watchOS 27.3, introducing new Audio Intelligence features: Live Rewind and Siri Recap. Live Rewind provides a 15-second transcript of recent audio, while Siri Recap offers high-level summaries of conversations. These features are not enabled by default and require opt-in through the iPhone Watch app, along with specific Apple Watch hardware and iOS beta versions. Live Rewind also necessitates an initial microphone calibration. Users can customize Siri Recap's activation times and locations, such as only during weekdays at the office. Initial testing of Live Rewind in a quiet home office environment produced accurate transcripts, though an audible chime signals its activation. Siri Recap, tested on an editorial planning meeting, identified topics and removed sensitive information, but the summary itself was not immediately useful for work tasks. Apple's approach to privacy for these features is detailed in public support documentation.

The introduction of Audio Intelligence features like Live Rewind and Siri Recap on Apple Watch signifies a significant step towards on-device AI processing for personal communication analysis. While current implementations focus on factual summarization and transcription, the potential for these features to evolve into more sophisticated conversational analysis, similar to third-party offerings that detect emotional tone or offer commerce-driven insights, is evident. Apple's emphasis on user opt-in and granular privacy controls suggests a cautious approach to integrating powerful AI capabilities that could profoundly alter how users interact with their devices and each other.

The market for AI-powered personal assistants and productivity tools is heating up, with Apple now directly competing with services that offer deeper conversational insights and integrations. The differentiation lies in Apple's focus on privacy and factual recall versus more interpretative or commercially-driven AI. Users will need to decide whether the convenience of passive summarization and transcription outweighs the potential for altered communication dynamics and the need for explicit consent from conversation participants, especially as these features mature and expand beyond their beta phase.