Snap Inc.

Nathan Litke

Ning Xu

Jianchao Yang

Jia Li

Rahul Bhupendra Sheth

Daniel Szeto

Jose Jesus (Joseph) Paredes

Justin Huang

Eyal Zak

David Ben Haim

Matthew Loukas Hanover

Michael Brian Murray

Alex Bamberger

Georgios Evangelidis

Branislav Micusik

Jakob Zillner

A method for aligning coordinate systems from separate augmented reality (AR) devices is described. In one aspect, the method includes generating predicted depths of a first point cloud by applying a pre-trained model to a first single image generated by a first monocular camera of a first augmented reality (AR) device, and first sparse 3D points generated by a first SLAM system at the first AR device, generating predicted depths of a second point cloud by applying the pre-trained model to a second single image generated by a second monocular camera of the second AR device, and second sparse 3D points generated by a second SLAM system at the second AR device, determining a relative pose between the first AR device and the second AR device by registering the first point cloud with the second point cloud.

Fast AR device pairing using depth predictions

A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor allows a user of the mobile device to edit and trim the video clips having the identified characteristics to create trimmed video clip segments.

Video highlights with user trimming

Systems and methods are provided for displaying a first portion of a video, the first portion comprising a subset of the video that fits in a display area of a computing device. The systems and methods further detect movement of the computing device during playback of the first portion of the video, calculate a rotation of the display of the first portion of the video based on a direction of the movement, and cause the display of the first portion of the video to rotate relative to the direction of movement to display a second portion of the video, the second portion comprising a subset of the video that is associated with the direction of movement and that was at least partially not visible in the first portion of the video when displayed in the display area of the computing device.

Processing a media content based on device movement

A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor automatically trims, or allows a user of the mobile device to edit and trim the video clips having the identified characteristics to create trimmed video clip segments. The processor enables a user of the mobile device to view, post, send, and export a selected said video clip segment to another user.

Video highlights with user viewing, posting, sending and exporting

Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

Processing and formatting video for interactive presentation

A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor automatically trims the video clips based on frames that have the identified characteristics to create trimmed video clip segments, and then sends the trimmed video clip segments to the mobile device.

Video highlights with auto trimming

Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.

Systems and methods are described for receiving, at a computing device, a plurality of video sources related to an event. For each video source of the plurality of video sources, the systems and methods further provide for analyzing, by the computing device, the video source of the plurality of video sources to determine a device orientation to associate with the video source, associating, by the computing device, the device orientation with the video source, and storing, by the computing device, the video source and the associated device orientation.

Systems and methods are described for receiving, at a computing device, a video comprising a plurality of frames and determining, by the computing device, that vertical cropping should be performed for the video. For each frame of the plurality of frames, the computing device processes the video by analyzing the frame to determine a region of interest in the frame, wherein the frame is a first frame, cropping the first frame based on the region of interest in the frame to produce a vertically cropped frame for the video, determining a second frame immediately preceding the first frame, and smoothing a trajectory from the second frame to the vertically cropped frame. The vertically cropped frame is displayed to a user instead of the first frame.

Systems and methods provide for detecting movement of the computing device during playback of media content on a display of the computing device, receiving movement data from one or more sensors of the computing device, analyzing the movement data to determine a direction of movement, calculating a rotation of the display of the media content based on the direction of movement, and causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.

Growing community of inventors

Venice, CA, United States of America

Nathan Litke