Microsoft Technology Licensing, LLC

Facebook, Inc.

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Microsoft Corporation

Michael F Cohen

Zicheng Liu

Zhengyou Zhang

Charles Edward Jacobs

Richard S Szeliski

Peter-Pike Johannes Sloan

Matthew Uyttendaele

Charles F Rose

Jue Wang

Steven Mark Drucker

Neel Suresh Joshi

Johannes P Kopf

Ying-Qing Xu

Matthieu Tony Uyttendaele

Johannes Peter Kopf

Li-Wei He

Heung-Yeung Shum

Eyal Ofek

Sing Bing Kang

Billy P Chen

Yong Rui

Blaise Aguera Y Arcas

Charles Lawrence Zitnick, Iii

Steven Jacob Gortler

Daniel Lischinski

Radek Grzeszczuk

Andrew David Wilson

Douglas Christopher Burger

Ross Garrett Cutler

Brian Keith Cabral

Curtis Glenn Wong

Hugues Herve Hoppe

Michael A Toelle

Li-wei He

Drew Edward Steedly

Asta Jane Roseway

Maneesh Agrawala

David H Salesin

Asta Glatzer

Wolf Kienzle

Daniel Massey

Bryan Kent Ressler

R Alex Colburn

Robert E Bodenheimer, Jr

Henrique Sarmento Malvar

Donald James Lindsay

Gary William Flake

Kalyan Krishna Sunkavalli

Jonathan J Huang

Andrew Garrod Bosworth

Eric H Rudolph

Ivan Jelev Tashev

Aseem Agarwala

Jason George McHugh

Cha Zhang

Lubomira A Dontcheva

Brian Kevin Guenter

Bo Thiesson

Brett David Brewer

Stephen L Lawler

Sudipta Narayan Sinha

Lin Liang

Daniel Morris

Karim Taji Farouki

Georg F Petschnigg

Eric Joel Stollnitz

Andrea Colaco

Timo Juhani Ahonen

Ariel J Lazier

Qing Luan

Piotr Dollar

Ronit Kassis

Hua Zhong

Hyon Lim

Steven Douglas De Mar

Matt Uyttendaele

Casey D Stein

Blaise Hilary Aguera Y Arcas

Ting Yu

Shinichi Manaka

Zhen Wen

Ke Zheng

Ryan Cairns

Jagannatha Koppal

Sisil Sanjeev Mehta

Yong Jae Lee

Alex Limpaecher

C Larry Zitnick

Sanjeev J Koppal

Daniel Lee Massey

Steven J Gortler

David Salesin

Johannes Kopf

Charles Lawrence Zitnick Iii

Daniel Scott Morris

Casey Stein

Iii Zitnick Charles Lawrence

In one embodiment, a computing system may receive, from a second computing system, video streams of a scene, the video streams including at least a first image and a second image that are simultaneously captured by a first camera and a second camera of the second computing system, respectively. The system may determine, using a sensor system, a viewpoint of a viewer with respect to a display region of a monoscopic display associated with the first computing system. The system may generate an output image of the scene by blending, according to blending proportions computed using the viewpoint of the viewer, corresponding portions of the first image and the second image. The system may display the output image in the display region of the monoscopic display.

Videotelephony with parallax effect

A method for using a virtual camera location to display image data to one device from another device associated with a plurality of cameras. The method includes receiving image data from a plurality of cameras associated with a second user device associated with a second user. The method further includes establishing a virtual camera location different from positions of the plurality of cameras. The method further includes providing an image using the image data on a first user display of a first user device based at least on a viewpoint of the virtual camera location.

Systems and methods for video communication using a virtual camera

Systems, methods, and non-transitory computer-readable media can generate an initial alpha mask for an image based on machine learning techniques. A plurality of uncertain pixels is defined in the initial alpha mask. For each uncertain pixel in the plurality of uncertain pixels, a binary value is assigned based on a nearest certain neighbor determination.

Systems and methods for image matting

The mobile image viewing technique described herein provides a hands-free interface for viewing large imagery (e.g., 360 degree panoramas, parallax image sequences, and long multi-perspective panoramas) on mobile devices. The technique controls the imagery displayed on a display of a mobile device by movement of the mobile device. The technique uses sensors to track the mobile device's orientation and position, and front facing camera to track the user's viewing distance and viewing angle. The technique adjusts the view of a rendered imagery on the mobile device's display according to the tracked data. In one embodiment the technique can employ a sensor fusion methodology that combines viewer tracking using a front facing camera with gyroscope data from the mobile device to produce a robust signal that defines the viewer's 3D position relative to the display.

Natural user interfaces for mobile image viewing

Various technologies described herein pertain to generation of an output hyper-lapse video from an input video. A smoothed camera path can be computed based upon the input video. Further, output camera poses can be selected from the smoothed camera path for output frames of the output hyper-lapse video. One or more selected input frames from the input video can be chosen for an output frame. The selected input frames can be chosen based at least in part upon an output camera pose for the output frame. Moreover, the selected input frames can be combined to render the output frame. Choosing selected input frames from the input video and combining the selected input frames can be performed for each of the output frames of the output hyper-lapse video.

Hyper-lapse video through time-lapse and stabilization

Various technologies described herein pertain to creation of an output hyper-lapse video from an input video. Values indicative of overlaps between pairs of frames in the input video are computed. A value indicative of an overlap between a pair of frames can be computed based on a sparse set of points from each of the frames in the pair. Moreover, a subset of the frames from the input video are selected based on the values of the overlaps between the pairs of the frames in the input video and a target frame speed-up rate. Further, the output hyper-lapse video is generated based on the subset of the frames. The output hyper-lapse video can be generated without a remainder of the frames of the input video other than the subset of the frames.

Real-time hyper-lapse video creation via frame selection

Systems and methods of a personal daemon, executing as a background process on a mobile computing device, for providing personal assistant to an associated user is presented. While the personal daemon maintains personal information corresponding to the associated user, the personal daemon is configured to not share the personal information of the associated user with any other entity other than the associated user except under conditions of rules established by the associated user. The personal daemon monitors and analyzes the actions of the associated user to determine additional personal information of the associated user. Additionally, upon receiving one or more notices of events from a plurality of sensors associated with the mobile computing device, the personal daemon executes a personal assistance action on behalf of the associated user.

Local personal daemon

The subject disclosure is directed towards modifying the apparent camera path from an existing video into a modified, stylized video. Camera motion parameters such as horizontal and vertical translation, rotation and zoom may be individually modified, including by an equalizer-like set of interactive controls. Camera motion parameters also may be set by loading preset data, such as motion data acquired from another video clip.

Interactively stylizing camera motion

Described is a user interface that displays a representation of a stereo scene, and includes interactive mechanisms for changing parameter values that determine the perceived appearance of that scene. The scene is modeled as if viewed from above, including a representation of a viewer's eyes, a representation of a viewing screen, and an indication simulating what each of the viewer eyes perceives on the viewing screen. Variable parameters may include a vergence parameter, a dolly parameter, a field-of-view parameter, an interocular parameter and a proscenium arch parameter.

Viewer-centric user interface for stereoscopic cinema

Various embodiments provide techniques for scrubbing variable paths in content. By way of example and not limitation, scrubbing can include receiving user input that defines a scrub path and navigating a data path through content based on the scrub path. According to some embodiments, a data path can include one or more predefined paths (e.g., a travel route) through the content. One or more of the techniques can account for variations in a data path and provide ways of maintaining adjacency between a scrub path and navigation along the data path. In some embodiments, a data path can be associated with one or more types of data path content that can be presented in response to a navigation of the data path.

Scrubbing variable content paths

Various technologies described herein pertain to juxtaposing still and dynamic imagery to create a cliplet. A first subset of a spatiotemporal volume of pixels in an input video can be set as a static input segment, and the static input segment can be mapped to a background of the cliplet. Further, a second subset of the spatiotemporal volume of pixels in the input video can be set as a dynamic input segment based on a selection of a spatial region, a start time, and an end time within the input video. Moreover, the dynamic input segment can be refined spatially and/or temporally and mapped to an output segment of the cliplet within at least a portion of output frames of the cliplet based on a predefined temporal mapping function, and the output segment can be composited over the background for the output frames of the cliplet.

Juxtaposing still and dynamic imagery for cliplet creation

Architecture that guides the freeform drawing of objects by a user to enable the user to produce improved drawings without significant training. As the user draws, the architecture dynamically updates a relevant shadow image proximate (e.g., underlying) the user's strokes. The strokes overlay an evolving shadow image, which shadow image is suggestive of object contours that guide the user during the drawing process. Relevant edge images selected from a large database are automatically blended to construct the shadow image. As the user draws, the strokes are dynamically analyzed using an encoding of overlapping windows for fast matching with the database of images. A top ranked set of matching database edge images are aligned to the drawing, a set of spatially varying weights blend the edge images into the shadow image, and a scoring technique is employed to select the optimum shadow image for display.

Realtime user guidance for freehand drawing

Image-based localization technique embodiments are presented which provide a real-time approach for image-based video camera localization within large scenes that have been reconstructed offline using structure from motion or similar techniques. From monocular video, a precise 3D position and 3D orientation of the camera can be estimated on a frame by frame basis using only visual features.

Image-based localization

Growing community of inventors

Seattle, WA, United States of America

Michael F Cohen