Facebook, Inc.

Vulcan Patents LLC

Interval Research Corporation

Eyegroove, Inc.

Vulcan Portals Inc.

Other

Snibbe Interactive, Inc.

Meta Platforms, Inc.

Scott Snibbe

William L Verplank

Graham McDermott

Spencer Schoeben

Jesse Fulton

Karon E MacLean

Justin Ponczec

Amir Mesguich Havilio

Baback Elmieh

Joyce Hsu

Alexandre Jais

Rex Wenters Crossen

Angela Chang

Justin Ponczek

Jayne B Roderick

Oliver Thomas Bayley

Golan Levin

Kimberly H Johnson

Robert S Shaw

Karon MacLean

Lukas Girling

Graham Mcdermott

Baldo Antonio Faieta

Annarosa Tomasi

Cy De Groat

Alan T Shimoide

In one embodiment, a method includes retrieving a media content item for display on a projectable surface. The method includes sending, to an interaction device including a projector and a camera, instructions causing the camera to capture one or more images of the projectable surface, receiving the one or more images from the interaction device, and determining one or more attributes of the surface based on the one or more images. The method also includes modifying the media content item based at least in part on the one or more attributes of the projectable surface and sending, to the interaction device, the modified media content item and instructions causing the projector to project the modified media content on the projectable surface.

Surface adaptation for projection-based augmented reality system

In one embodiment, a method includes sending, to an interaction device including a projector and a camera, a media content item and instructions causing the projector to project the media content item on a projectable surface and receiving, from the interaction device, one or more media objects captured by the camera, where one or more of the media objects include images of a user in proximity to the projectable surface. The method includes determining one or more movements of the user based on the one or more of the media objects and updating the media content item based on the determined movements. The method also includes sending, to the interaction device, the updated media content item and instructions causing the projector to project the updated media content item on the projectable surface.

User detection for projection-based augmented reality system

A method includes retrieving a media content item for display to a user in an environment. The method includes receiving, from one or more interaction devices each including a projector and a camera, one or more media objects captured by one or more cameras, where one or more of the media objects include images of the user, and determining a location of the user in the environment based on an analysis of the one or more of the media objects. The method also includes identifying one of the interaction devices based on the determined location of the user and sending, to the identified interaction device, the media content item and instructions causing the projector associated with the identified interaction device to project the media content item.

Surface selection for projection-based augmented reality system

A method includes sending, to an interaction device including a projector and a camera, instructions causing the projector to project a light pattern to each of one or more specified directions and receiving, from the interaction device, one or more images each including illumination patterns associated with one or more surfaces of a specified direction. The method also includes constructing, based on the projected light patterns and the received illumination patterns, a model describing an environment of the interaction device, where the model includes one or more characteristics of each of one or more objects in the environment and one or more characteristics of each of one or more surfaces in the environment.

Modeling for projection-based augmented reality system

Techniques are provided to help social networking users manage their augmented reality identity. In particular, a user may customize one or more perception profiles, each of which specifying a selection and an arrangement of augmented reality elements to display over a view of the user. The user may further associate each perception profile with a relationship category that may be defined by the user. In this way, users gain more control over what image to project to different categories of people and is thereby empowered to express their identities in a context-appropriate way.

Techniques for using perception profiles with augmented reality systems

An audio social networking environment is described that provides a platform for users to generate audio-only content for consumption by one or more other users that may or may not have a social networking relationship with the user creating the audio-only content. Users are able to verbally generate stories using an audio based virtual assistant that receives the stories. The stories are analyzed to identify a tone of the story and one or more categories to associate with the story. The analysis of the story can also include suggesting audio effects to the user for including in the story. When a user requests stories, the user preference information of the requester can be used to identify stories for playback that meet the requesting user's preferences.

Sonic social network

The various embodiments described herein include methods and systems for presenting interactive media items. In one aspect, a method includes publishing, by a server system, an interactive media item, the publishing comprising providing access for a playback of the interactive media item based on metadata for the interactive media item. The metadata is generated using information associated with the interactive media item and including a mapping of an effect parameter for a first effect of the one or more effects to a touch input gesture. Playback includes, in response to detecting a first user input gesture corresponding to the touch input gesture, applying the first effect to the presented interactive media item. The applying of the first effect includes determining the effect parameter according to one or more characteristics of the first user input gesture, based on the mapping of the effect parameter to the touch input gesture.

Methods and devices for presenting interactive media items

The various embodiments described herein include methods and systems for generating interactive media items. In one aspect, a method is performed at a server system. The method includes providing access for playback of an interactive media item based on metadata generated using information associated with the interactive media item. The metadata includes information associating at least one parameter with the interactive media item. The interactive media item is generated based on one or more user inputs selecting one or more interactive effects for association with the interactive media item. The user input(s) cause the server system to make the one or more interactive effects available to a subsequent viewer during the playback of the interactive media item, such that the subsequent viewer is able to interact with video and/or audio of the interactive media item by controlling the at least one parameter during the playback.

Methods and devices for touch-based media creation

The various embodiments described herein include methods and systems for storage of media item metadata. In one aspect, a method is performed at a server system with one or more processors and memory. The method includes receiving, from a client device, metadata corresponding to a modified media item, where the modified media item is a modified version of a media item corresponding to a particular node in a family tree within a database of media items. The method further includes, in response to receiving the metadata corresponding to the modified media item, appending, to the family tree, a new leaf node that is linked to the particular node, where the new leaf node corresponds to the modified media item.

Methods and systems for storage of media item metadata

The various implementations described herein include methods, devices, and systems for generating media items. In one aspect, a method is performed at a server system. The method includes: (1) receiving one or more audio files; (2) obtaining one or more audio characteristics for the audio files; (3) receiving a request to generate a media item using the audio files, the request including one or more criteria; and (4) in response to receiving the request, generating the media item, including: (a) identifying one or more visual media files based on the criteria and the audio characteristics; and (b) generating synchronization information; (5) storing the media item in the server system; and (6) enabling playback of the media item by sending a link for the stored media item to the client device.

Methods and devices for generating media items

A server system with one or more processors and memory receives, from a client device, information including one or more criteria for a media item to be generated. In some embodiments, the one or more criteria include one or more audio tracks for the media item to be generated. In some embodiments, the one or more criteria include one or more keywords for the media item to be generated. The server system identifies one or more media files in a database of media files for the media item to be generated based at least in part on the one or more criteria. The server system sends, to the client device, first information identifying the one or more media files. In some embodiments, the server system also sends, to the client device, synchronization information for synchronizing one or more audio tracks with the one or more identified media files.

An electronic device with one or more processors and memory detects a user input to play a media item, where the media item is associated with at least a portion of an audio track and one or more media files. The device requests the media item from a server in response to the user input and, in response to the request, receives, from the server, the one or more media files and information identifying at least the portion of the audio track. The device obtains at least the portion of the audio track based on the information identifying at least the portion of the audio track. The device also displays the one or more media files and, while displaying the one or more media files, plays back at least the portion of the audio track in synchronization with the one or more media files.

Methods and devices for synchronizing and sharing media items

An electronic device with processor(s), memory, and a touch screen display presents a media item, where the media item is associated with a metadata structure that includes first information identifying at least a portion of an audio track, second information identifying one or more media files, and third information identifying one more audio and/or video effects. The presenting includes: displaying one or more media files associated with the media item; and playing back at least a portion of an audio track associated with the media item in synchronization with the one or more media files. While presenting the media item, the device: detects a touch input gesture; and, in response to detecting the touch input gesture, applies an audio and/or video effect specified by the third information to the audio track being played back and/or at least a portion of the one or more media files being displayed.

An electronic device with one or more processors and memory displays a first user interface including a plurality of audio tracks, detects a first user input selecting one of the plurality of audio tracks, and, in response to detecting the first user input, displays a second user interface for recording a video clip. The device also detects a second user input to initiate recording of the video clip and detects a third user input to stop recording of the video clip. The device further detects a fourth user input to publish the media item based on the video clip and the selected audio track and, in response to detecting the fourth user input, publishes the media item to a server, including sending to the server information identifying the selected audio track, the video clip, and information related to synchronization of the selected audio track and the video clip.

A server system with one or more processors and memory maintains a database for a plurality of root media items, where: a respective root media item is associated with a family tree that includes a genesis node and multiple leaf nodes; and the genesis node corresponds to the respective root media item and a respective leaf node of the multiple leaf nodes corresponds to a first modified media item that is a modified version of the respective root media item. The server system: receives at least a portion of modified metadata corresponding to a second modified media item that is a modified version of a media item corresponding to a respective node in the family tree; and, in response, appends, to the family tree, a new leaf node that is linked to the respective node, where the new leaf node corresponds to the second modified media item.

Growing community of inventors

San Francisco, CA, United States of America

Scott Snibbe