Barnes & Noble College Booksellers, LLC

Facebook, Inc.

Barnesandnoble.com LLC

Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Amir Mesguich Havilio

Kourtny Minh Hicks

Gerald B Cueto

Baback Elmieh

Scott Snibbe

Joyce Hsu

Alexandre Jais

Rex Wenters Crossen

Dale J Brewer

Angela Chang

Christopher Richard Tanner

Michelle Pujals

Nicholas Wallen

Gioacchino Noris

Alessia Marra

Matthew Luther

Paulo Melchiori

Amber Choo

Jesse John Mullen

Andrew Hargreaves

In one embodiment, a method includes receiving an instruction to transition to a first virtual reality (VR) environment of a first VR application, accessing attribute information of one or more real-world objects in a real-world environment proximate to a VR display device, determining, for each of the one or more real-world objects, one or more first mixed reality (MR) functionalities applicable to the real-world object based on its attribute information, and rendering, for one or more displays of the VR display device, the first VR environment with one or more MR objects corresponding to the one or more real-world objects, wherein each MR object comprises one of the first MR functionalities applicable to the corresponding real-world object.

Platformization of mixed reality objects in virtual reality environments

In one embodiment, a method includes rendering, for one or more displays of a VR display device, a first output image of a VR environment. The VR environment includes a personal UI associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user, is a virtual object comprising one or more 2D virtual displays, and is operable to execute a plurality of applications. The method includes determining whether to adapt the personal UI based on a detected change in a context of the first user with respect to the VR environment. The method includes rendering a second output image of the VR environment, where the personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI based on the detected change in the context of the first user.

Adaptable personal user interfaces in cross-application virtual reality settings

In one embodiment, a method includes displaying, for one or more displays of a virtual VR device, a first output image comprising a passthrough view of a real-world environment. The method includes identifying, using one or more images captured by one or more cameras of the VR display device, a real-world object in the real-world environment. The method includes receiving a user input indicating a first dimension corresponding to the real-world object. The method includes automatically determining, based on the first dimension, a second and third dimension corresponding to the real-world object. The method includes rendering, for the one or more displays of the VR display device, a second output image of a VR environment. The VR environment includes a MR object that corresponds to the real-world object. The MR object is defined by the determined first, second, and third dimensions.

Mixed reality objects in virtual reality environments

Techniques are disclosed for providing a swipe-based confirmation mode in electronic touch sensitive devices. The user can engage the confirmation mode by performing a command (e.g., delete or power down command), which causes the device to display a confirmation swipe gesture prompt. The confirmation prompt may be included within a confirmation graphic or a confirmation pop-up window. By performing the confirmation swipe gesture on the touch sensitive surface, the user may confirm the command. By not properly performing the confirmation gesture, closing a confirmation pop-up window, tapping an area of the screen not associated with the confirmation prompt, or otherwise not performing the confirmation swipe gesture, the device may cause the function to be cancelled.

Swipe-based confirmation for touch sensitive devices

In one embodiment, a method includes retrieving a media content item for display on a projectable surface. The method includes sending, to an interaction device including a projector and a camera, instructions causing the camera to capture one or more images of the projectable surface, receiving the one or more images from the interaction device, and determining one or more attributes of the surface based on the one or more images. The method also includes modifying the media content item based at least in part on the one or more attributes of the projectable surface and sending, to the interaction device, the modified media content item and instructions causing the projector to project the modified media content on the projectable surface.

Surface adaptation for projection-based augmented reality system

In one embodiment, a method includes sending, to an interaction device including a projector and a camera, a media content item and instructions causing the projector to project the media content item on a projectable surface and receiving, from the interaction device, one or more media objects captured by the camera, where one or more of the media objects include images of a user in proximity to the projectable surface. The method includes determining one or more movements of the user based on the one or more of the media objects and updating the media content item based on the determined movements. The method also includes sending, to the interaction device, the updated media content item and instructions causing the projector to project the updated media content item on the projectable surface.

User detection for projection-based augmented reality system

Techniques are disclosed for providing a digital flash card function in electronic devices. In an embodiment, a digital flash card includes a word or phrase along with the definition of the word or phrase pulled automatically from a glossary or dictionary. The digital flash card may be created through an options menu after selecting a word or phrase, automatically whenever a word or phrase is highlighted by the user, or whenever a word or phrase is looked up. Once the flash cards have been created, they may be organized into various folders or stacks, and in some cases the flash cards may automatically be organized based on the source of the selected word or phrase. Once one or more flash cards have been created, the user may view flash cards, flip them over to view the opposite side, and scroll through the flash cards using various touch screen gestures.

Digital flash card techniques

Features and techniques are disclosed for interacting with paginated digital content, including a multi-purpose tool and an annotation mode. The multi-purpose tool, which may be represented by a graphic (e.g., a movable interactive graphic), can provide access to multiple modes (e.g., copy, define, note, and/or highlight modes) that a user can invoke. The mode invoked determines the functions performed by the tool when interacting with the paginated digital content. The annotation mode, which may be invoked using the multi-purpose tool or independently thereof, can allow a user to create and edit annotations, such as highlights and notes (e.g., sticky notes, margin notes, and/or highlight notes), for paginated digital content. Editing the annotations may include selecting a desired color for the annotation, for example. The annotation mode may also allow a user to intuitively merge and delete annotations previously added to paginated digital content.

Editing annotations of paginated digital content

A method includes retrieving a media content item for display to a user in an environment. The method includes receiving, from one or more interaction devices each including a projector and a camera, one or more media objects captured by one or more cameras, where one or more of the media objects include images of the user, and determining a location of the user in the environment based on an analysis of the one or more of the media objects. The method also includes identifying one of the interaction devices based on the determined location of the user and sending, to the identified interaction device, the media content item and instructions causing the projector associated with the identified interaction device to project the media content item.

Surface selection for projection-based augmented reality system

A method includes sending, to an interaction device including a projector and a camera, instructions causing the projector to project a light pattern to each of one or more specified directions and receiving, from the interaction device, one or more images each including illumination patterns associated with one or more surfaces of a specified direction. The method also includes constructing, based on the projected light patterns and the received illumination patterns, a model describing an environment of the interaction device, where the model includes one or more characteristics of each of one or more objects in the environment and one or more characteristics of each of one or more surfaces in the environment.

Modeling for projection-based augmented reality system

Multi-purpose tool for interacting with paginated digital content

An online system enables users to post media content items, comprising images or videos, for display to other users of the system. The online system receives media content from a posting user that is associated with a caption including text content. If the online system detects the text content of the caption includes a string of link text identifying an address, the online system prompts the posting user to pay a fee in exchange for generating a link based on the link text. Responsive to receiving payment of the fee from the posting user, the online system generates the link within the caption. The generated link comprises a selectable object displayed within the caption that when activated by a client device causes the client device to access a digital location specified by the address. The media content item and caption are sent for display to one or more other users of the online system.

Adding paid links to media captions in a social networking system

Techniques are disclosed for digital content zooming. In one example case, the hypotenuse of the digital content (or a combination of both height and width values of the content) is initially set to provide the 100% zoom level and is subsequently used to resize or zoom that content. In particular, an arbitrary constant that is independent of the content itself is used to define the initial or 100% zoom level at which the content is initially displayed. The arbitrary constant may be, for example, a hypotenuse size in pixels, or a specific combination of height and width in pixels. In one specific example, the arbitrary constant can be selected based on, for instance, an average of current physical screen and/or virtual viewing window resolutions' hypotenuse sizes, in pixels. In any case, the arbitrary constant can be used to set the initial size of the content, and to compute zoom steps.

Growing community of inventors

Palo Alto, CA, United States of America

Amir Mesguich Havilio