Magic Leap, Inc.

Microsoft Technology Licensing, LLC

Meta Platforms Technologies, LLC

Magig Leap, Inc.

Paul Armistead Hoover

James M Powderly

Savannah Niles

Lorena Pazmino

Jonathan Lawrence Mann

Gregory Minh Tran

Cole Parker Heiner

Marshal Ainsworth Fontaine

Alysha Naples

Niels Van Dongen

John Austin Day

James Cameron Petty

Frank Alexander Hamilton, Iv

Chris Sorrell

Daniel John Wigdor

Michael J Patten

Emily K Rimas-Ribikauskas

Dustin Hubbard

Kieran M Phelan

Isioma Osagbemwenorue Azu

Jennifer M R Devine

Frank Hamilton

Jing Ma

Sam Baker

Carlos Pessoa

Craig Erickson

Nicholas Randall Waggoner

Maxim Mazeev

Chris Whytock

John Wesley Terrell

Tucker Spofford

Richard St Claire Bailey

Victoria Kruse

Jarrod Lombardo

Hrvoje Benko

Robert J Levy

Jan-Kristian Markiewicz

Adrian James Garside

Sarat Chandra Subramaniam

Sundaram Ramani

Joshuah Vincent

Sears Young

Theresa B Pittappilly

Sangwoo Han

Joyce Wu

Camila Cortes De Almeida E De Vincenzo

Jenna Velez

Ana Garcia Puyol

Maxim Oustiogov

Kay Hofmeester

Luis Eduardo Cabrera Cordon

Ian Middleton

Maxim V Mazeev

Display panel or portion thereof with a transitional mixed reality graphical user interface

Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The object can be rendered closer to the user than the cursor. A group of virtual objects can be scrolled, and a virtual control panel can be displayed indicating objects that are upcoming in the scroll.

Eclipse cursor for virtual content in mixed reality displays

Methods, systems, and storage media for transmitting three-dimensional (3D) objects via messaging applications are disclosed. Exemplary implementations may: receive, at a first device running a messaging application, a message from a second device; import the 3D object to a personal account of a user of the first device; and display the 3D object in the messaging application.

Transmitting three-dimensional objects via messenger

A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Interactions with 3D virtual objects using poses and multiple-dof controllers

A wearable device can have a field of view through which a user can perceive real or virtual objects. The device can display a visual aura representing contextual information associated with an object that is outside the user's field of view. The visual aura can be displayed near an edge of the field of view and can dynamically change as the contextual information associated with the object changes, e.g., the relative position of the object and the user (or the user's field of view) changes.

Visual aura around field of view

Aspects of the present disclosure are directed to controlling a sending side of an augmented call based on a receiving user's gaze. Some implementations provide a hologram moderation system in which a receiving user's gaze can control how the system generates a representation of a sending user on a sending side. For example, some implementations can moderate the capture or generation of hologram data representing the sending user when the receiving user isn't focused on the hologram that results from the data. Such moderations can reduce power consumption, bandwidth, heat production, and/or processing power needed by the artificial reality system when the receiving user is not looking at the hologram of the sending user, such as when the sending user is in the receiving user's periphery or outside the receiving user's field-of-view.

Controlling an augmented call based on user gaze

Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

Virtual reticle for augmented reality systems

Interactions with 3D virtual objects using poses and multiple-DOF controllers

Examples of systems and methods for a wearable system to automatically select or filter available user interface interactions or virtual objects are disclosed. The wearable system can select a group of virtual objects for user interaction based on contextual information associated with the user, the user's environment, physical or virtual objects in the user's environment, or the user's physiological or psychological state.

Contextual awareness of user interface menus

Aspects of the present disclosure are directed to a mini-map coordination system that can facilitate interactions between co-located and non-co-located users by providing a min-map through an artificial reality system. The mini-map can be a representation of a virtual space that corresponds to a real-world space in which some users are located and that other users join virtually. Users can join the space by entering the real-world space or by remotely logging into the virtual space. Users who have joined the virtual space can be represented in the mini-map by avatars. Users moving their avatars around the mini-map can trigger interactions, such as automatically initiating a holographic call between the users whose avatars come within a threshold distance of each other. The system can allow remote users to observe social norms such as requiring a user to 'knock' before their avatar is allowed to enter a private space.

Coordinating virtual interactions with a mini-map

Augmented reality systems and methods for automatically repositioning a virtual object with respect to a destination object in a three-dimensional (3D) environment of a user are disclosed. The systems and methods can automatically attach the target virtual object to the destination object and re-orient the target virtual object based on the affordances of the virtual object or the destination object. The systems and methods can also track the movement of a user and detach the virtual object from the destination object when the user's movement passes a threshold condition.

Automatic placement of a virtual object in a three-dimensional space

Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. The focus indicator may be emphasized in directions closer to the cursor and deemphasized in directions farther from the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The cursor and focus indicator can provide the user with positional feedback and help the user navigate among objects in the environment.

Eclipse cursor for mixed reality displays

Aspects of the present disclosure are directed to a holographic calling system providing holographic calling between an artificial reality device and a mobile device having both front and back facing cameras. The user of the mobile device can position it so one of the cameras is pointed toward their face and another camera captures the user's hand not holing the mobile device. The holographic calling system can automatically determine the position of the mobile device in relation to the user's face and hand. Once the mobile device is positioned within an appropriate capture zone, the captured images of the user's face are used to create a first representation of the sending user's face, the captured images of the user's hand are used to create a second representation of the sending user's hand. Each representation is provided as output from a receiving artificial reality device, positioned relative to each other.

Mobile device holographic calling with front and back camera capture

Growing community of inventors

Bothell, WA, United States of America

Paul Armistead Hoover