Apple Inc.

Benjamin S Phipps

Karl Ferdinand Schramm

Xinyuan Huang

Bryan Hansen

Jaireh Tecarro

Yifeng Gui

Mahesh Ramaray Shanbhag

Eugene Ray

Nikrouz Ghotbi

Sumit Wattal

Anumita Biswas

Gagan A Gupta

Justin G Binder

Po Keng Sung

Kurt W Piersol

Heriberto Nieto

Andrew J Sinesio

Rebecca P Fish

Kisun You

William M York

Thomas R Gruber

Gregory B Novick

Bob Bradley

Gordon J Freedman

Edward T Schmidt

Daniel S Keen

Brandon J Newendorp

Christopher Dean Brigham

Vincent M Lane

Sachin S Kajarekar

Patrick L Coffman

Luis R Deliz Centeno

David Rahardja

Gennaro Frazzingaro

Susan L Booker

Jessica J Peck

Chaitanya Mannemala

Corey J Peterson

Gregory Lutter

Evan S Dibiase

Michael R Sumner

Peter Allan Laurens

Paulo R Jansen Dos Reis

Yutaka Yokokawa

Roshni Malani

Peter Burgner

Harry Simmonds

Erik Marchi

Ashwin K Vijay

Guilherme Klink

Vince Lane

Stephen H Shum

David Rahardia

Jonathan J Moore

Christopher Verwymeren

Brandon K Schmuck

Andrew Muehlhausen

Thomas Robert Gruber

Gregory Novick

A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

Controlling devices using a wearable device

This relates to intelligent automated assistants and, more specifically, to intelligent context sharing and task performance among a collection of devices with intelligent automated assistant capabilities. An example method includes, at a first electronic device participating in a context-sharing group associated with a first location: receiving a user voice input; receiving, from a context collector, an aggregate context of the context-sharing group; providing at least a portion of the aggregate context and data corresponding to the user voice input to a remote device; receiving, from the remote device, a command to perform one or more tasks and a device identifier corresponding to a second electronic device; and transmitting the command to the second electronic device based on the device identifier, wherein the command causes the second electronic device to perform the one or more tasks.

Digital assistant hardware abstraction

Embodiments described herein provide a network system to enable content playback on multiple devices. An electronic device can receive information associated with media playback request and resolve a media item and intended playback device for the media request based on a set of available media items and player devices. The device can then transmit, via the data interface, a request to play the media item at the player device via a secure device to device communication system.

Network system for content playback on multiple devices

A device implementing a system for sharing a voice profile includes a processor configured to receive a request to share a first voice profile corresponding to a first user account associated with a first device, with a second device associated with a second user account, the second device being voice-enabled, the first voice profile being stored on a first data store associated with the first user account. The processor is further configured to update a second data store associated with the second user account to include a reference to the first voice profile stored on the first data store, and to send, to the second device, a notification that the second data store has been updated to include the reference to the first voice profile.

Multi-user devices in a connected home environment

An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Spoken notifications

The present disclosure generally relates to using voice interaction to access call functionality of a companion device. In an example process, a user utterance is received. Based on the user utterance and contextual information, the process causes a server to determine a user intent corresponding to the user utterance. The contextual information is based on a signal received from the companion device. In accordance with the user intent corresponding to an actionable intent of answering the incoming call, a command is received. Based on the command, instructions are provided to the companion device, which cause the companion device to answer the incoming call and provide audio data of the answered incoming call. Audio is outputted according to the audio data of the answered incoming call.

Voice interaction at a primary device to access call functionality of a companion device

Systems and processes for providing a virtual assistant service are provided. In accordance with one or more examples, a method includes receiving, from an accessory device communicatively coupled to the first electronic device, a representation of a speech input representing a user request. The method further includes detecting a second electronic device and transmitting, from the first electronic device, a representation of the user request and data associated with the detected second electronic device to a third electronic device. The method further includes receiving, from the third electronic device, a determination of whether a task is to be performed by the second electronic device in accordance with the user request; and in accordance with a determination that a task is to be performed by the second electronic device, requesting the second electronic device to performed the task in accordance with the user request.

Virtual assistant operations in multi-device environments

This relates to intelligent automated assistants and, more specifically, to the intelligent coordination of audio signal output adjustments among multiple electronic devices. An example method includes, generating a local audio intent object associated with a software application stored on a first electronic device, the local audio intent object including one or more local audio parameters; determining that a second electronic device that is outputting an audio signal is proximate to the first electronic device; generating a proximate audio intent object corresponding to the second electronic device based on the one or more local audio adjustment parameters and a round-trip time (RTT) of a communication connection between the first electronic device and the second electronic device; and transmitting the proximate audio intent object to the second electronic device via the communication connection, wherein the proximate audio intent object causes the second electronic device to adjust the output of the audio signal.

Multi-device audio adjustment coordination

Systems and processes for operating an intercom system via a digital assistant are provided. The intercom system is trigger-free, in that users communicate, in real-time, via devices without employing a trigger to speak. Acoustic fingerprints are employed to associate users with devices. Acoustic fingerprints include vector embeddings of speech input in an acoustic-feature vector space. Speech heard at multiple devices, as embedded in a fingerprint, may be clustered in the vector space, and the structure of the clusters is employed to associate users and devices. Based on the fingerprints, a device is mapped to a user, and the user employs that device to participate in a conversation, via the intercom service.

Device arbitration for digital assistant-based intercom systems

Systems and processes for operating an intelligent automated assistant are provided. In one example process, information associated with media playback is received from one or more user devices. A speech request for a media item is received from a user. At least the speech request and the information associated with media playback is transmitted to a second electronic device. Based on at least the speech request and the information associated with media playback, an instruction for media playback on a secondary user device is received. At least one task is performed based on the instruction for media playback.

Content playback on multiple devices

Virtual assistant operation in multi-device environments

Growing community of inventors

San Francisco, CA, United States of America

Benjamin S Phipps