Apple Inc.

Samsung Electronics Co., Ltd.

Tobias Rick

Alexandre Da Veiga

Bryce L Schmidtchen

Vedant Saran

Alexander Menzies

Michael I Weinstein

Bryan Cline

Tsao-Wei Huang

Ricardo Jansson Motta

Zachary Z Becker

Brett D Miller

Rafael Saracchini

Ozgur Oyman

Dan C Lelescu

Gary Lee Vondran, Jr

Arun Rakesh Yoganandan

Manohar B Srikanth

Nan-Wei Gong

Henry N Holtzman

Kumi Akiyoshi

Keming Cao

Zejing Wang

Ziv Hendel

Jae Chung

Stephan R Richter

Gabriel D Molina

Vladlen Koltun

Charles O Goddard

Aaron Wetzler

Mohammad Nassar

Vicky Kogan

Guy Rapaport

Amaël Delaunoy

Various implementations disclosed herein include devices, systems, and methods that convert a mono image to a stereo image pair. For example, a process may obtain an input image including appearance values at pixel positions. The input image corresponds to an appearance of a scene from a first viewpoint. The process may further determine a depth image comprising depth values at original pixel positions that are mapped to corresponding pixel positions of the input image. The process may further generate a first output image corresponding to a second viewpoint of the scene different than the first viewpoint and a second output image corresponding to a third viewpoint of the scene different than the second viewpoint. The process may further enable comfort-based 3D style presets for adjusting comfort parameters for viewing a stereo image pair.

Mono to stereo image conversion and adjustment for viewing on a spatial computer

Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

Techniques for displaying and capturing images

An electronic device is provided that includes a first camera with a first field of view configured to capture a first image, a second camera with a second field of view configured to capture a second image, and control circuitry configured to output stereoscopic content based on the first and second images. The control circuitry can include image signal processors configured to process the first and second images, additional processors for performing stereo rectification and image stabilization on the first and second images, and a compression block for combining images output from the additional processors.

Stereoscopic capture using cameras with different fields of view

Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

Visual techniques for 3D content

Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.

Single-pass object scanning

A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.

Display system having sensors

A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.

Panoramic light field capture, processing, and display

In one aspect, a modular sensing apparatus will be described. The modular sensing apparatus includes a flexible substrate and multiple sensors. The flexible substrate is reconfigurable into different shapes that conform to differently shaped structures. The multiple sensors are positioned on the substrate. Various embodiments relate to software, devices and/or systems that involve or communicate with the modular sensing apparatus.

Sensing apparatus

Growing community of inventors

Mountain View, CA, United States of America

Tobias Rick