Apple Inc.

Samsung Electronics Co., Ltd.

Tobias Rick

Ricardo Jansson Motta

Alexandre Da Veiga

Zachary Z Becker

Brett D Miller

Bryce L Schmidtchen

Vedant Saran

Tsao-Wei Huang

Bryan Cline

Michael I Weinstein

Alexander Menzies

Rafael Saracchini

Dan C Lelescu

Gary Lee Vondran, Jr

Arun Rakesh Yoganandan

Manohar B Srikanth

Nan-Wei Gong

Henry N Holtzman

Kumi Akiyoshi

Zejing Wang

Ziv Hendel

Jae Chung

Charles O Goddard

Gabriel D Molina

Aaron Wetzler

Mohammad Nassar

Vicky Kogan

Guy Rapaport

An electronic device is provided that includes a first camera with a first field of view configured to capture a first image, a second camera with a second field of view configured to capture a second image, and control circuitry configured to output stereoscopic content based on the first and second images. The control circuitry can include image signal processors configured to process the first and second images, additional processors for performing stereo rectification and image stabilization on the first and second images, and a compression block for combining images output from the additional processors.

Stereoscopic capture using cameras with different fields of view

Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

Techniques for displaying and capturing images

Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

Visual techniques for 3D content

Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.

Single-pass object scanning

A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.

Display system having sensors

A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.

Panoramic light field capture, processing, and display

In one aspect, a modular sensing apparatus will be described. The modular sensing apparatus includes a flexible substrate and multiple sensors. The flexible substrate is reconfigurable into different shapes that conform to differently shaped structures. The multiple sensors are positioned on the substrate. Various embodiments relate to software, devices and/or systems that involve or communicate with the modular sensing apparatus.

Sensing apparatus

Growing community of inventors

Mountain View, CA, United States of America

Tobias Rick