Starting today, Siri can tune the Apple Watch microphone with Audio Intelligence features that are available in the new watchOS 27.3 developer beta rolling out now. The two new additions are Siri Recap, which uses “ambient listening” to generate summaries of your conversation, and Live Rewind, which generates text transcripts of the last 15 seconds of audio detected by your watch’s microphone.
Apple is also releasing its redesigned Health app for testing today in the iOS 27.3 developer beta and announced expanded language support in English, Chinese (Simplified and Traditional), French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese. Add sections like a new Insights tab with summaries of heart, sleep, fitness, and other data that appear throughout the day, a For You section with personalized recommendations, and health content like educational videos and articles.
When it comes to the implications of an ambient and always listening AI, Apple has released this Audio Intelligence
Privacy overview (pdf) on how you plan to protect users’ privacy when their watch is listening 24 hours a day. It goes into detail about Apple’s claims that users’ raw audio “is handled within dedicated hardware, is not saved as a file, and is not accessible to the operating system, apps, or Apple.” According to Apple, “if you use iCloud with two-factor authentication and have a device passcode, any Siri Recap digest or Live Rewind text snippet you choose will save the syncs on your devices end-to-end encrypted in the Siri app.”