Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Microsoft Technology Licensing, LLC

Charlene Mary Atlas

Mark Terrano

Caryn Vainio

Chad Austin Bramwell

Jasmine Soria Sears

Kevin James MacKenzie

Nathan Seigo Matsuda

Thomas Scott Murdison

Romain Bachy

Ocean Quigley

John Benjamin Hesketh

Jamie R Cabaccang

Nadine Sharon Anglin

Xiaoyu Liu

Auset Parris

An example method is provided for applying a virtual lighting effect to virtual content based on ambient light associated with a real-world scene. The example method includes obtaining a measurement of ambient light associated with a scene of a real-world environment. The example method includes applying a virtual lighting effect to virtual content based at least in part on the measurement of the ambient light. And the example method includes causing display of the virtual content with the applied virtual lighting effect on a display of a computing device for displaying augmented reality, wherein the scene of the real-world environment is visible through the display.

Techniques for adaptively rendering virtual content n artificial reality environments based on ambient lighting of a real-world scene

A necklace manager of an interactive necklace can sense user conditions and transmit messages to recipient computing devices. The necklace manager can compare sensed user conditions from the interactive necklace sensors to predefined user condition templates to determine a match. The matching predefined user condition template can be mapped to a user intent. The necklace manager can, in response to mapping the sensed user conditions to the user intent, transmit a message to a recipient device that is based on the mapped user intent and a user identifier. In some implementations, the recipient device can be an other interactive necklace that performs a mapped interactive necklace action in response to the received message. For example, a wearer of the recipient interactive necklace can perceive sentiments, emotions, and/or reactions from a user wearing the originating interactive necklace by perceiving interactive necklace actions triggered by the received message.

Interactive necklace with user condition sensing

The present disclosure relates to systems, methods, and non-transitory computer-readable media that initiate communication between users of a networking system within an extended reality environment. For example, the disclosed systems can generate an extended-reality lobby window graphical user interface element for display on an extended-reality device of a user. The disclosed systems can further determine a connection between the user and a co-user and provide an animated visual representation of the co-user for display within the extended-reality lobby window graphical user interface element. In response to receiving user input targeting the animated visual representation of the co-user, the disclosed systems can generate and send, for display on an extended-reality device of the co-user, an invitation to join an extended-reality communication session with the user.

Generating an extended-reality lobby window for communication between networking system users

In one embodiment, a computing device may determine a virtual content to be displayed with a scene of a real-world environment. The device may generate an image depicting the virtual content. Using one or more sensors, the device may detect characteristics of the scene of the real-world environment. Based on the image and the characteristics of the scene, the device may determine that a visual enhancement is to be applied to the virtual content depicted in the image to enhance a contrast between the depicted virtual content and the scene. The device may generate a visually-enhanced image depicting the virtual content by applying the visual enhancement to the virtual content depicted in the image. The device may display the visually-enhanced image of the virtual content on a display of the computing device, wherein the scene of the real-world environment is visible through the display.

Adaptive rendering in artificial reality environments

This disclosure describes an artificial reality system that presents artificial reality content in the context of a physical environment that includes a mirror or other reflective surface. In one example, this disclosure describes a method that includes capturing capture data representative of a physical environment, wherein the physical environment includes a reflective surface and a plurality of objects, determining a pose of the HMD, determining a map of the physical environment, wherein the map includes position information about the reflective surface and position information about each of the plurality of physical objects in the physical environment, identifying a visible object from among the plurality of physical objects, and generating artificial reality content associated with the visible object.

Movement instruction using a mirror in an artificial reality environment

Performing operations using a mirror in an artificial reality environment

Presenting artificial reality content using a mirror

In some examples, a virtual surface presented by an artificial reality (AR) system may be a virtual drawing surface in an artificial reality environment, with which users may interact using a physical peripheral device. For example, the AR system may enable a user to draw or write on a surface of the peripheral device and may simultaneously, i.e., along with the user inputs, render virtual markings corresponding to the user inputs on a virtual drawing surface locked to the surface of the peripheral device. In some cases, the AR system enables the user to 'transfer' the virtual markings rendered on the surface of the peripheral device (e.g., a virtual drawing) to another virtual drawing surface (e.g., to a planar or other surface in the artificial reality environment).

Virtual drawing surface interaction using a peripheral device in artificial reality environments

In general, the disclosure describes artificial reality (AR) systems and techniques for generating and presenting virtual surfaces within an artificial reality environment and for facilitating user interaction with the virtual surfaces using a physical peripheral device. For example, AR systems are described that generate and render virtual surfaces, such as a virtual pinboard or a virtual drawing surface (e.g., a virtual canvas) in an artificial reality environment, for display to a user. The AR systems enable the user to interact with the virtual surfaces using a physical peripheral device, which may be manipulated and otherwise interacted with by the user to provide input to an AR system through pose tracking of the peripheral device and/or via one or more input devices of the peripheral device, such as a presence-sensitive surface.

Virtual pinboard interaction using a peripheral device in artificial reality environments

An artificial reality system includes a head mounted display (HMD) and a compass generator that generates a proximity compass used to locate virtual or physical elements within an artificial reality environment. The artificial reality system can render a proximity compass around or in proximity to a virtual device, a virtual or physical object, or at a designated location. The proximity compass includes graphical elements that can represent virtual experiences (applications, games, utilities etc.), physical or virtual objects, and physical or virtual locations within the artificial reality environment. The positioning of a graphical element within the proximity compass represents a direction of the associated experience, object or location with respect to the HMD. The graphical elements within the proximity compass may rotate around a virtual hand-held device when the user changes the orientation of the hand-held device. The graphical elements may include data that identifies the experience associated with the graphical element.

Virtual proximity compass for navigating artificial reality environments

In some examples, a method comprises: obtaining, by an artificial reality system including a head mounted display (HMD), image data via an image capture device, the HMD configured to output artificial reality content; detecting, by the artificial reality system, a physical peripheral device from the image data; detecting, by the artificial reality system, a pose of the peripheral device; generating, by the artificial reality system, based on the pose of the peripheral device, a virtual pointer along at least a portion of a line between the peripheral device and a virtual surface, the virtual pointer pointing at a location of the virtual surface; performing, by the artificial reality system, one or more actions based on the location of the virtual surface; and rendering, by the artificial reality system, the virtual pointer and the virtual surface for display at the HMD.

Pointer-based interaction with a virtual surface using a peripheral device in artificial reality environments

The herein described technology facilitates sharing of notes and files with a locked computing device. The locked computing device may receive a file sharing request that includes a file identifier identifying a location of a source file. The locked processing device provides a user account of the processing device with access to content of the source file responsive to authentication of a recipient access credential associated with the user account.

Growing community of inventors

Redmond, WA, United States of America

Charlene Mary Atlas