Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Facebook, Inc.

Lars Anders Bond

Christopher John Ocampo

Stefano Zanetti

Nadav Grossinger

Oskar Linde

Michael Slater

Stef Marc Smet

Niv Kantor

Francesco Georg

Henrik Hegner Tomra Skovsgaard

Hannes Verlinde

This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.

Artificial reality triggered by physical object

A virtual reality (VR) system is described that enables users to create, model, and visualize augmented reality experiences at physical, real-world locations, without needing to physically be at the location for which the augmented experience is being modeled. In one example, the VR system includes a head-mounted device (HMD), an augmented reality content development system, and a rendering engine. The HMD is configured to output VR content representing a physical environment for an augmented reality experience. The augmented reality content development system is configured to identify, based on an input, augmented reality content with which to augment the physical environment for the augmented reality experience. The rendering engine is configured to render, via the HMD, the VR content representing the physical environment, augmented with the augmented reality content.

Virtual reality-based augmented reality development system

Disclosed herein includes a system, a method, and a device for interacting with displayed items. A contact point can be established with a surface of a contact panel and the contact panel can be operated in a navigation mode during which a selection element, for selecting one or more items of a user interface (UI) in a display of a second device, is maintained at a determined location in the display. The UI can be moved in the display relative to the selection element as the selection element is maintained at the determined location, by moving the contact point on the surface of the contact panel in the navigation mode. At least one item of the UI that is moved within a selection threshold of the selection element can be selected by removing the contact point with the contact panel.

Systems and methods for interacting with displayed items

The disclosed method may include (1) sensing, via a depth-sensing subsystem, a plurality of locations in three-dimensional space corresponding to physical surfaces in a real-world environment, (2) determining a dominant plane within the real-world environment, (3) defining a three-dimensional grid that is aligned with the dominant plane, (4) identifying, based on the plurality of locations relative to the dominant plane, a set of grid coordinates within the three-dimensional grid that are indicative of the physical surfaces, and (5) determining, based on the set of grid coordinates, a safety boundary to be employed by a head-mounted display system to notify a user of the head-mounted display system of the user's proximity to the physical surfaces. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for determining a safety boundary for a mobile artificial reality user

The present invention relates to a control device for controlling a camera arrangement (), said control device having a front end and a back end, said control device comprising: attachment means () configured to attach a camera arrangement () to said control device; gripping means () configured to facilitate for a user to hold said control device; interaction means () configured for controlling a camera arrangement () when attached to said control device; wide-angle lens means () arranged to be positioned on said attachment means () in front of a camera lens of a camera arrangement () when attached to said control device; and actuator means () configured to control said interaction means () and arranged at said gripping means () to facilitate use thereof for a user holding said control device by said gripping means (), wherein said attachment means () is arranged on said control device to fix a camera lens of a camera arrangement () when attached to said control device towards the front end of said control device, and to fix a touchscreen of a camera arrangement () when attached to said control device towards the back end of said control device.

Growing community of inventors

San Mateo, CA, United States of America

Lars Anders Bond