Apple Inc.

Barry-John Theobald

Nicholas Elia Apostoloff

Russell Y Webb

Garrett L Weinberg

Sachin S Kajarekar

Chaitanya Mannemala

Saurabh Adya

Srikanth Vishnubhotla

Ahmed S Hussen Abdelaziz

Alexander W Churchill

Megan M Maher

Katherine Elaine Metcalf

Ognjen Rudovic

Erik Marchi

Pranay Dighe

Seyedmahdad Mirsamadi

Nataniel Ruiz Gutierrez

Ahmed H Tewfik

An example process includes: receiving a speech input representing a user utterance; determining, based on a textual representation of the speech input, a first score corresponding to a type of the user utterance; determining, based on the textual representation of the speech input, a second score representing a correspondence between the user utterance and a domain recognized by a digital assistant; determining, based on the first score and the second score, whether the speech input is intended for the digital assistant; in accordance with a determination that the speech input is intended for the digital assistant: initiating, by the digital assistant, a task based on the speech input; and providing an output indicative of the initiated task.

Determining whether speech input is intended for a digital assistant

A method includes obtaining a speech proficiency value indicator indicative of a speech proficiency value associated with a user of the electronic device. The method further includes in response to determining that the speech proficiency value satisfies a threshold proficiency value: displaying training text via the display device; obtaining, from the audio sensor, speech data associated with the training text, wherein the speech data is characterized by the speech proficiency value; determining, using a speech classifier, one or more speech characterization vectors for the speech data based on linguistic features within the speech data; and adjusting one or more operational values of the speech classifier based on the one or more speech characterization vectors and the speech proficiency value.

Interactive reading assistant

A method includes, while displaying a first set of text content via a display device, determining an engagement value that characterizes a level of user engagement with respect to the first set of text content. The method includes, in accordance with a determination that the engagement value satisfies a threshold, replacing the first set of text content with a second set of text content via the display device. The first set of text content is different from the second set of text content. The method includes in accordance with a determination that the engagement value does not satisfy the threshold, maintaining display of the first set of text content via the display device.

A method includes obtaining user input interaction data. The user input interaction data includes one or more user interaction input values respectively obtained from the corresponding one or more input devices. The user input interaction data includes a word combination. The method includes generating a user interaction-style indicator value corresponding to the word combination in the user input interaction data. The user interaction-style indicator value is a function of the word combination and a portion of the one or more user interaction input values. The method includes determining, using a semantic text analyzer, a semantic assessment of the word combination in the user input interaction data based on the user interaction-style indicator value and a natural language assessment of the word combination. The method includes generating a response to the user input interaction data according to the user interaction-style indicator value and the semantic assessment of the word combination.

Generating responses to user interaction data based on user interaction-styles

Controlling an automated agent in an environment includes obtaining high-quality data regarding a current state of the automated agent; identifying a behavior model; determining a trajectory estimate for the automated agent based on the current state of the automated agent and the behavior model; determining a final trajectory for the automated agent using the trajectory estimate; and controlling the automated agent according to the final trajectory.

Multimodal input processing system

One aspect of the disclosure is a non-transitory computer-readable storage medium including program instructions. Operations performed by execution of the program instructions include obtaining an input image that depicts a face of a subject, having an initial facial expression and an initial pose, determining a reference shape description based on the input image, determining a target shape description based on the reference shape description, a facial expression difference, and a pose difference, generating a rendered target shape image using the target shape description, and generating an output image based on the input image and the rendered target shape using an image generator, wherein the output image is a simulated image of the subject of the input image that has a final expression that is based on the initial facial expression and the facial expression difference, and a final pose that is based on the initial pose and the pose difference.

Face image generation with pose and expression control

A method includes displaying a first set of text content characterized by a first difficulty level. The method includes obtaining speech data associated with the first set of text content. The method includes determining linguistic feature(s) within the speech data. The method includes in response to completion of the speech data, determining a reading proficiency value associated with the first set of text content and based on the linguistic feature(s). The method includes in accordance with determining the reading proficiency value satisfies change criteria, changing a difficulty level for a second set of text content. After changing the difficulty level, the second set of text content corresponds to a second difficulty level different from the first difficulty level. The method includes in accordance with determining the reading proficiency value does not satisfy the change criteria, maintaining the second set of text content at the first difficulty level.

Growing community of inventors

Sunnyvale, CA, United States of America

Barry-John Theobald