Apple Inc.

Other

Shaun D Budhram

Mark E Drummond

Siva Chandra Mouli Sivapurapu

Edward S Ahn

Aashi Manglik

Behrooz Mahasseni

Patrick Steven Piemonte

Daniel De Rocha Rosario

Scott M Herz

Bruno M Sommer

Payal Jotwani

Connor A Smith

Wolf Kienzle

Bo Morgan

Daniel Laszlo Kovacs

Jason D Gosnell

Kjell F Bronder

Clément Pierre Nicolas Boissière

Dan Feng

Mu Qiao

Tucker Bull Morgan

Michael J Gutensohn

Vyacheslav Leizerovich

Madhurani R Sapre

Douglas C Bowman

Noah Jonathan Gamboa

Douglas A Bowman

Noah Gamboa

In one implementation, a method of composing a scene content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes generating a definition of a scene based on textual or speech input and a model of a physical environment, wherein the definition includes a constraint that defines a spatial relationship between a virtual asset and an anchor asset that corresponds to one or more physical objects in the physical environment. The method includes generating, based on the definition of the scene and the model of the physical environment, a first instance of the scene that satisfies the constraint with the virtual asset in the spatial relationship with a first one of the one or more physical objects in the physical environment. The method includes presenting, on the display, the first instance of the scene.

Methods and systems for composing and executing a scene

Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, while the physical muting mode is active, a system obtains a first set of context data for one or more physical elements in a physical setting and causes display of a virtual object representing the one or more physical elements in a first position using at least a portion of the first set of context data. After the virtual object representing the one or more physical elements is displayed in the first position, the physical muting mode is deactivated. In response to detecting the deactivation of the physical muting mode, the system causes display of a transitional motion of the virtual object representing the one or more physical elements from the first position to a second position.

Muting mode for a virtual object representing one or more physical elements

In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, a system is provided that receives an input from a user of a mobile machine which indicates or describes an object in the world. In one example, the user may gesture to the object which is detected by a visual sensor. In another example, the user may verbally describe the object which is detected by an audio sensor. The system receiving the input may then determine which object near the location of the user that the user is indicating. Such a determination may include utilizing known objects near the geographic location of the user or the autonomous or mobile machine.

Systems and methods for relative representation of spatial objects and disambiguation in an interface

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network.

Systems and methods for generating an interactive user interface

Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, a system obtains context data for one or more physical elements in a physical setting, wherein the context data includes first context data and second context data that is different from the first context data. In some examples, in response to obtaining the context data for the one or more physical elements in the physical setting, a system causes display of a virtual object that represents the one or more physical elements using the first context data without using the second context data, in accordance with a determination that a physical muting mode is active.

In one implementation, a method for modeling a behavior with synthetic training data. The method includes: obtaining source content that includes an entity performing one or more actions within an environment; generating a first environment characterization vector characterizing the environment; generating a first set of behavioral trajectories associated with the one or more actions of the entity based on the source content and the first characterization vector for the environment; generating a second environment characterization vector for the environment by perturbing the first environment characterization vector; generating a second set of behavioral trajectories associated with one or more potential actions of the entity based on the source content and the second characterization vector for the environment; and training a behavior model for a virtual agent based on the first and second sets of behavioral trajectories in order to imitate the entity.

Method and device for modeling a behavior with synthetic training data

In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.

Method and device for generating a blended animation

Systems and methods for determining an object through a disambiguated selection in a mixed reality interface

Growing community of inventors

San Jose, CA, United States of America

Shaun D Budhram