Snap Inc.

Qualcomm Incorporated

Meta View, Inc.

Campfire 3d, Inc.

Benjamin Lucas

Edmund Graves Brown

Jonathan M Rodriguez, Ii

Richard Zhuang

Mayan Shay May-Raz

Forest Rouse

Paulo Jansen

Joshua Hernandez

David Meisenholder

Michael E Stein

Simon Nielsen

Kharis O'Connell

Jonathan M Rodriguez Ii

A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.

AR odometry sensor fusion using personal vehicle sensor data

Systems, methods, and computer readable media that determines distances for mixed reality interaction, where the methods include determining a first position of a point of a surface and rendering a virtual reality (VR) interactive item comprising a VR interactive control. The methods further include tracking a control indicator controlled by the user by determining a first plurality of positions of the control indicator and activating the VR interactive control in response to detecting the control indicator controlled by the user transgressing a first threshold distance from the VR interactive control. The methods further include determining a closest position of the first plurality of positions to the point based on the first position, determining the point of the surface to have a second position based on the determined closest position plus a constant for the control indicator, and associating a second threshold with the point of the surface.

Distance determination for mixed reality interaction

Systems, methods, and computer readable media for selecting a tilt angle of an augmented reality (AR) display of an AR wearable device. Some examples of the present disclosure capture simulation data of gaze fixations while users are performing tasks using applications resident on the AR wearable device. The tilt angle of the AR display is selected based on including more gaze fixations that are within the field of view (FOV) of the AR display than are outside the FOV of the AR display. In some examples, an AR wearable device is manufactured with a fixed vertical tilt angle for the AR display. In some examples, the AR wearable device can dynamically adjust the vertical tilt angle of the AR display based on the applications that a user of the AR wearable device is likely to use or is using.

Selecting a tilt angle of an AR display

An Augmented Reality (AR) system provides stabilization of hand-tracking input data. The AR system provides for display a user interface of an AR application. The AR system captures, using one or more cameras of the AR system, video frame tracking data of a gesture being made by a user while the user interacts with the AR user interface. The AR system generates skeletal 3D model data of a hand of the user based on the video frame tracking data that includes one or more skeletal 3D model features corresponding to recognized visual landmarks of portions of the hand of the user. The AR system generates targeting data based on the skeletal 3D model data where the targeting data identifies a virtual 3D object of the AR user interface. The AR system filters the targeting data using a targeting filter component and provides the filtered targeting data to the AR application.

Hand-tracking stabilization

Systems and methods to extend an interactive experience across multiple platforms are presented herein. The interactive experience may take place in an interactive space. The interactive space as experienced by a user of a host device (e.g., headset) may be extended to one or more mobile computing platforms. The host device may present views of virtual content perceived to be present within the real world. A given mobile computing platform may be positioned at or near the host device. The mobile computing platform may take images/video of the user of the host device. The mobile computing platform may superimpose views of the virtual content onto the images/video from the perspective of the mobile computing platform. The virtual content presented at the mobile computing platform may be perceived to be in the real world.

Systems and methods to extend an interactive space across multiple platforms

Eyewear providing an interactive augmented reality experience to users in a first physical environment viewing objects in a second physical environment (e.g., X-ray effect). The second environment may be a room positioned behind a barrier, such as a wall. The user views the second environment via a sensor system moveable on the wall using a track system. As the user in the first environment moves the eyewear to face the outside surface of the wall along a line-of-sight (LOS) at a location (x, y, z), the sensor system on the track system repositions to the same location (x, y, z) on the inside surface of wall. The image captured by the sensor system in the second environment is wirelessly transmitted to the eyewear for displayed on the eyewear displays, providing the user with an X-ray effect of looking through the wall to see the objects within the other environment.

Augmented reality eyewear with x-ray effect

Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.

Situational-risk-based AR display

A method of locating a personal mobility system using an augmented reality device is disclosed. The method comprises receiving positional data corresponding to a location of a personal mobility system, determining a relative position between the augmented reality device and the location of the personal mobility system, and causing the display of an augmented reality effect by the augmented reality device based on the relative position between the augmented reality device and the location of the personal mobility system.

AR-enhanced detection and localization of a personal mobility device

A method of controlling a personal mobility system includes displaying a virtual object on an augmented reality wearable device, the virtual object being located in a position in the field of view of the augmented reality device corresponding to a position in the real world. Proximity of the personal mobility system or a user of the personal mobility system with the position in the real world is detected. In response to the detection of proximity, a performance characteristic of the personal mobility system is modified.

AR based performance modulation of a personal mobility system

AR odometry using sensor data from a personal vehicle

AR-enhanced gameplay includes a map of a course including a plurality of virtual objects, the map corresponding to a location in the real world and defining a track along which participants can ride on personal mobility systems such as scooters. Virtual objects are displayed in the fields of view of participants' augmented reality devices in a positions corresponding to positions in the real world on the course. Proximity of a participant or their personal mobility system with the position of a virtual object in the real world is detected, and in response to the detection of proximity, a performance characteristic of the participant's personal mobility system is modified.

AR enhanced gameplay with a personal mobility system

A system configured to facilitate interactions with virtual content in an interactive space may comprise one or more of a hand tracking device, a light source, an optical element, one or more physical processors, non-transitory electronic storage, and/or other components. The hand tracking device may be configured to generate output signals conveying ranges of surfaces and/or objects present in the real world. A hand of a user may be identified and tracked through three-dimensional space. A virtual cursor may be presented as positionally linked with the hand. The virtual cursor may be modified to reflect change in hand pose. As the hand comes close to virtual objects, an individual virtual object may be modified to reflect which virtual object is closest to the hand.

Growing community of inventors

San Francisco, CA, United States of America

Benjamin Lucas