Magic Leap, Inc.

Snap Inc.

Karen Stolzenberg

Lorena Pazmino

Cole Parker Heiner

Andrea Isabel Montoya

Gregory Minh Tran

Tim Zurmoehle

Frank Alexander Hamilton, Iv

Christina Lee

Savannah Niles

Isioma Osagbemwenorue Azu

Marc Alan McCall

John Austin Day

Ian Mankowski

Paul Kim

David Meisenholder

Mathieu Emmanuel Vignau

Timothy Michael Stutts

Daniel Moreno

Kyle Goodrich

James M Powderly

Kaveh Anvaripour

Brian Everett Meaney

Amy Dedonato

Shin Hwun Kang

Colman Thomas Bryant

Amy DeDonato

Thomas Marshall Miller, Iv

William Adams

Praveen Babu J D

Koichi Mori

Victor Ng-Thow-Hing

Richard St Clair Bailey

Jehangir Tajik

Leonid Zolotarev

Joseph Timothy Fortier

Rodrigo Cano

Rohit Anil Talwalkar

Josh Anon

Eric Norman Yiskis

Ian Michener Bradley

Viktoria Hwang

Domingo Noriega-Padilla

Siddartha Pothapragada

Anthony Marinello

Stephane Antoine Joseph Imbert

Jonathan Lawrence Mann

Jordan Alexander Cazamias

James Cameron Petty

Griffith Buckley Hazen

Rose Mei Peng

Sana Park

Terek Judi

Craig Erickson

Daria Skrypnyk

Sean Eugene Couture

Tianyi Sun

Kristian Bauer

Tiago Rafael Duarte

Yu Jiang Tham

Ilteris Kaan Canberk

Rajan Vaish

William Wheeler

Sven Kratz

Brian Anthony Smith

Megan Ann Geiman

James Powderly

Sarah Machicado

Praveen Babu Jd

Spencer Davis

Kenneth Kian Ann Tay

Jonathan David Garn

Daryl Francis Tanghe

Frank Alexander Hamilton Iv

Thomas Marshall Miller Iv

A host device having a first processor executes an application via the first processor. The host device determines a state of the application. A scenegraph is generated corresponding to the state of the application, and the scenegraph is presented to a remote device having a display and a second processor. The remote device is configured to, in response to receiving the scenegraph, render to the display a view corresponding to the scenegraph, without executing the application via the second processor.

Application sharing

Display screen or portion thereof with a graphical user interface

A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.

Gaze timer based augmentation of functionality of a user input device

Example systems, devices, media, and methods are described for controlling the presentation of one or more virtual or graphical elements on a display in response to bimanual hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a first hand and defines a mapped region relative to a surface of the detected first hand. The system presents a virtual target icon at a position within or near the mapped region. The image processing system detects a series of bimanual hand shapes, including the detected first hand and at least one fingertip of a second hand. In response to determining whether the detected series of bimanual hand shapes matches a predefined hand gesture, the system executes a selecting action that includes presenting one or more graphical elements on the display.

Bimanual interactions between mapped hand regions for controlling virtual and graphical elements

Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.

Contextual-based rendering of virtual avatars

Disclosed are systems and methods for mixed reality collaboration. A method may include receiving persistent coordinate data; presenting a first virtual session handle to a first user at a first position via a transmissive display of a wearable device, wherein the first position is based on the persistent coordinate data; presenting a virtual object to the first user at a second location via the transmissive display, wherein the second position is based on the first position; receiving location data from a second user, wherein the location data relates a position of the second user to a position of a second virtual session handle; presenting a virtual avatar to the first user at a third position via the transmissive display, wherein the virtual avatar corresponds to the second user, wherein the third position is based on the location data, and wherein the third position is further based on the first position.

Session manager

Examples of systems and methods for interacting with content and updating the location and orientation of that content using a single controller. The system may allow a user to use the same controller for moving content around the room and interacting with that content by tracking a range of the motion of the controller.

Content movement and interaction using a single controller

A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to perform operations to initiate or join a joint visual computing session. The method may comprise receiving user input to initiate a joint session of a visual computing experience, monitoring for short-range data transmissions including data indicating the existence of a current session of the visual computing experience, and based on determining that a current session is in progress, providing a user input option to join the current session of the visual computing experience.

Shared augmented reality session creation

Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

Hand gestures for animating and controlling virtual and graphical elements

Disclosed is a method of receiving and processing content-sending inputs received by a head-worn device system including one or more display devices, one or more cameras and a vertically-arranged touchpad. The method includes displaying a content item on the one or more display devices, receiving a touch input on the touchpad corresponding to a send instruction, displaying a carousel of potential recipients, receiving a horizontal touch input on the touchpad, scrolling the carousel left or right on the one or more display devices in response to the horizontal touch input, receiving a tap touch input on the touchpad to select a particular recipient, receiving a further touch input, and in response to the further touch input, transmitting the content item to the selected recipient.

Selecting items displayed by a head-worn display device

Example systems, devices, media, and methods are described for controlling the presentation of one or more virtual or graphical elements on a display in response to bimanual hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a first hand and defines an input plane relative to a surface of the detected first hand. The image processing system also detects a series of bimanual hand shapes, including the detected first hand and at least one fingertip of a second hand. In response, the system presents a first movable element on the display at a location that is correlated with the current fingertip location. In addition, the image processing system determines whether the detected series of bimanual hand shapes matches a predefined hand gesture. In response to a matching gesture, the system executes a selecting action of an element nearest the current fingertip location.

Bimanual gestures for controlling virtual and graphical elements

Neutral avatars are neutral with reference physical characteristics of the corresponding user, such as weight, ethnicity, gender, or even identity. Thus, neutral avatars may be desirable to use in various copresence environments where the user desires to maintain privacy with reference to the above-noted characteristics. Neutral avatars may be configured to convey, in real-time, actions and behaviors of the corresponding user without using literal forms of the user's actions and behaviors.

Neutral avatars

An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate or identify a user's location. The AR device can project graphics at designated locations within the user's environment to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to explore the user's environment.

Mapping and localization of a passable world

Growing community of inventors

Fort Lauderdale, FL, United States of America

Karen Stolzenberg