Apple Inc.

Other

Ian M Richter

Peter Meier

Daniel Ulbricht

Raffi A Bedikian

Olivier Soares

Gutemberg B Guerra Filho

Amritpal Singh Saini

Michael J Rockwell

Omar Elafifi

Cameron J Dunn

Jean-Daniel E Nahmias

Christopher T Eubank

Tomlinson M Holman

Andrew Scott Robertson

John Christopher Russell

Patrick W O'Keefe

Mark E Drummond

Siva Chandra Mouli Sivapurapu

Qi Shan

Eshan Verma

Bo Morgan

John Joon Park

Maxime Meilland

David Michael Hobbins

Michael Elliot Reisman

Stephen Patrick Mullen, Ii

John C Russell

Mohamed Selim Ben Himane

Bradley Warren Peebler

Peter Georg Meier

Jack R Greasley

David A Winarsky

Brian Erik Goldberg

Jeremy Ray Bernstein

Richard D Driver

Carl E Dorman

Nathan Choderker

Eric A Soulvie

Michael John Cafarella

Patrick W O'KEEFE

In one implementation, a method includes presenting, via a display device, a first synthesized reality (SR) view of an event that includes SR content associated with the event. The SR content includes a plurality of related layers of SR content that perform actions associated with the event. The method includes detecting, via one or more input devices, selection of a respective layer among the plurality of related layers of SR content associated with the event. The method includes presenting, via the display device, a second SR view of the event that includes the respective layer of SR content in response to the selection of the respective layer. The second SR view corresponds to a point-of-view of the respective layer.

Method and devices for presenting and manipulating conditionally dependent synthesized reality content threads

Various implementations disclosed herein include devices, systems, and methods for presenting objective-effectuators in synthesized reality settings. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes instantiating an objective-effectuator into a synthesized reality setting. In some implementations, the objective-effectuator is characterized by a set of predefined actions and a set of visual rendering attributes. In some implementations, the method includes obtaining an objective for the objective-effectuator. In some implementations, the method includes determining contextual information characterizing the synthesized reality setting. In some implementations, the method includes generating a sequence of actions from the set of predefined actions based on the contextual information and the objective. In some implementations, the method includes modifying the objective-effectuator based on the sequence of actions.

Objective-effectuators in synthesized reality settings

First content may be obtained in response to identifying a first physical element of a first object type. The first content may be associated with the first object type. Second content may be obtained in response to identifying a second physical element of a second object type. The second content may be associated with the second object type. The second physical element may be detected as being within a threshold distance of the first physical element. Third content may be generated based on a combination of the first content and the second content. The third content may be associated with a third object type that is different from the first object type and the second object type. The third content may be displayed on the display.

Generating content for physical elements

In one implementation, a method of presenting content is performed by a device including an image sensor, a display one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes classifying, based on the image of the physical environment, the physical environment as a particular environment type of a plurality of environment types. The method includes obtaining content based on the particular environment type. The method includes displaying, on the display, a representation of the content in association with the physical environment.

Method and device for presenting content based on environment type

Various implementations disclosed herein include devices, systems, and methods for capturing a new media content item. In various implementations, a device includes a display, one or more processors and a non-transitory memory. In some implementations, a method includes determining a plot template for generating a media content item based on other media content items that are distributed temporally. In some implementations, the plot template is defined by a set of one or more conditional triggers for capturing the other media content items. In some implementations, the method includes determining that a condition associated with a first conditional trigger of the set of one or more conditional triggers is satisfied. In some implementations, the method includes in response to the condition associated with the first conditional trigger being satisfied, displaying, on the display, a notification to capture a new media content item for populating the plot template.

Personalized content creation

In one implementation, a method of generating CGR content to accompany an audio file including audio data and lyric data based on semantic analysis of the audio data and the lyric data is performed by a device including a processor, non-transitory memory, a speaker, and a display. The method includes obtaining an audio file including audio data and lyric data associated with the audio data. The method includes performing natural language analysis of at least a portion of the lyric data to determine a plurality of candidate meanings of the portion of the lyric data. The method includes performing semantic analysis of the portion of the lyric data to determine a meaning of the portion of the lyric data by selecting, based on a corresponding portion of the audio data, one of the plurality of candidate meanings as the meaning of the portion of the lyric data. The method includes generating CGR content associated with the portion of the lyric data based on the meaning of the portion of the lyric data.

Method and device for presenting a CGR environment based on audio data and lyric data

In various implementations, a method comprises: identifying a plurality of data items, each of the plurality of data items having at least a first metadata field or a second metadata field; displaying a volumetric environment including a first plurality of SR objects corresponding to a first plurality of data items among the plurality of data items, wherein the first plurality of data items includes the first metadata field with first metadata field values; detecting a first user input indicative of the second metadata field; and in response to detecting the first user input, replacing the first plurality of SR objects within the volumetric environment with a second plurality of SR objects corresponding to a second plurality of data items among the plurality of data items, wherein each of the second plurality of data items includes the second metadata field with second metadata field values.

Method and device for presenting a synthesized reality user interface

Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.

Generating a three-dimensional environment based on an image

In some implementations, a method includes obtaining an end state of a first content item spanning a first time duration. In some implementations, the end state of the first content item indicates a first state of a synthesized reality (SR) agent at the end of the first time duration. In some implementations, the method includes obtaining an initial state of a second content item spanning a second time duration subsequent the first time duration. In some implementations, the initial state of the second content item indicates a second state of the SR agent at the beginning of the second time duration. In some implementations, the method includes synthesizing an intermediary emergent content item spanning over an intermediary time duration that is between the end of the first time duration and the beginning of the second time duration.

Intermediary emergent content

Various implementations disclosed herein include devices, systems, and methods for generating a response to a user focus indicator value based on a user comprehension value characterizing a user's association with the user focus indicator value. In some implementations, a method includes obtaining a user focus indicator value. A sequence of user voice inputs relating to the user focus indicator value is obtained. A user comprehension value characterizing an assessment of a user relative to the user focus indicator value is determined based on the user voice inputs. Based on a plurality of media content items that provide information about the user focus indicator value, a response to the user focus indicator value is synthesized that satisfies the user comprehension value. The response is outputted.

Conversational agent as learning aid

Various implementations disclosed herein include devices, systems, and methods for synthesizing virtual speech. In various implementations, a device includes a display, an audio sensor, a non-transitory memory and one or more processors coupled with the non-transitory memory. A computer-generated reality (CGR) representation of a fictional character is displayed in a CGR environment on the display. A speech input is received from a first person via the audio sensor. The speech input is modified based on one or more language characteristic values associated with the fictional character in order to generate CGR speech. The CGR speech is outputted in the CGR environment via the CGR representation of the fictional character.

Assisted speech

A method includes displaying, via a display, an environment that includes a representation of a person associated with the device. The representation includes a virtual face with virtual facial features corresponding to respective physical facial features of the person associated with the device. The method includes detecting, via a sensor, a change in a physical facial feature of the person associated with the device. The physical facial feature indicates a physical facial expression of the person. In response to determining that the physical facial expression breaches a criterion, modifying one or more virtual facial features of the virtual face so that the virtual face indicates a virtual facial expression that satisfies the criterion.

Assisted expressions

In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

Method and device for presenting synthesized reality companion content

In some implementations, a method of generating a third person view of a computer-generated reality (CGR) environment is performed at a device including non-transitory memory and one or more processors coupled with the non-transitory memory. The method includes: obtaining a first viewing vector associated with a first user within a CGR environment; determining a first viewing frustum for the first user within the CGR environment based on the first viewing vector associated with the first user and one or more depth attributes; generating a representation of the first viewing frustum; and displaying, via the display device, a third person view of the CGR environment including an avatar of the first user and the representation of the first viewing frustum adjacent to the avatar of the first user.

Method and device for visualizing sensory perception

Various implementations disclosed herein include devices, systems, and methods for obfuscating location data associated with a physical environment. In some implementations, a method includes obtaining, via an environmental sensor, environmental data corresponding to a physical environment. A first portion of the environmental data that corresponds to a first location is identified. In response to the first location being of a first location type, location data indicative of the first location is obfuscated from the environmental data by modifying the first portion of the environmental data.

Growing community of inventors

Los Angeles, CA, United States of America

Ian M Richter