Audio Intelligence is already here in beta: how it works

With the first beta of watchOS 27.3, Apple introduces the two main Audio Intelligence features on the new Apple Watch Series 12 and Ultra 4. We’re talking about Live Rewind and Siri Recap, which thanks to the S11 chip let us revisit what we just heard and access summaries of the most important conversations. Let’s see how they work.

Revisiting a conversation and remembering its details

Live Rewind shows us a transcript of the last 15 seconds of a conversation whenever we press the Digital Crown twice. To prevent this feature from being activated covertly, the watch plays a sound and shows an animation when you activate it, alerting people nearby even if we have the Apple Watch on silent.

Otter: Transcribe Voice Notes Download

Siri Recap, meanwhile, creates summaries with a title and the key points of our conversations. We can schedule this feature by time and location, check the summaries in the Siri app, and save them for later. The summaries are automatically deleted after seven days, unless we decide to keep them.

Privacy and reliability, the two keys to their success

As we already saw when talking about Audio Intelligence’s privacy, the Apple Watch processes audio in a protected environment that no app, nor even the operating system itself, can access. It then uses Private Cloud Compute to generate the summaries. Both features require our explicit activation.

In both the summaries and the rewinds, the text doesn’t identify the participants, so it’s useful only for reference, not as proof of a conversation, since it’s impossible to know who said what.

For now both features are only available in English and join sound recognition and automatic song recognition via Shazam, which is also included in this version of the operating system. All in all, we have a very natural way to enjoy artificial intelligence from our wrist.

Author: David Bernal Raspall

{ "de-DE": "Architekt | Gründer von hanaringo.com | Trainer für Apple-Technologien | Autor bei Softonic und iDoo_tech, zuvor bei Applesfera", "en-US": "Architect | Founder of hanaringo.com | Apple Technologies Trainer | Writer at Softonic and iDoo_tech, formerly at Applesfera", "es-ES": "Arquitecto | Creador de hanaringo.com | Formador en tecnologías Apple | Redactor en Softonic y iDoo_tech y anteriormente en Applesfera", "fr-FR": "Architecte | Créateur de hanaringo.com | Formateur en technologies Apple | Rédacteur chez Softonic et iDoo_tech, précédemment chez Applesfera", "it-IT": "Architetto | Fondatore di hanaringo.com | Formatore in tecnologie Apple | Scrittore per Softonic e iDoo_tech, precedentemente su Applesfera", "ja-JP": "建築家 | hanaringo.comの創設者 | アップル技術のトレーナー | SoftonicおよびiDoo_techのライター、以前はApplesferaで", "nl-NL": "Architect | Oprichter van hanaringo.com | Trainer in Apple-technologieën | Schrijver bij Softonic en iDoo_tech, voorheen bij Applesfera", "pl-PL": "Architekt | Założyciel hanaringo.com | Trener technologii Apple | Pisarz w Softonic i iDoo_tech, wcześniej w Applesfera", "pt-BR": "Arquiteto | Fundador do hanaringo.com | Instrutor em tecnologias Apple | Escritor na Softonic e iDoo_tech, anteriormente na Applesfera", "social": { "email": "races_provost0x@icloud.com", "facebook": "", "twitter": "https://twitter.com/david_br8", "linkedin": "https://www.linkedin.com/in/davidbernalraspall/" } }