Qualcomm Mems Technologies, Inc.

Outward, Inc.

Idc, LLC

Iridigm Display Corporation

Schlumberger Technology Corporation

Qualcomm Incorporated

Clarence Chui

Manish Kothari

Manu Parmar

Jeffrey Brian Sampsell

Marc Mignard

William J Cummings

Ming-Hau Tung

Mark W Miles

Brian James Gally

Lauren Palmateer

Mithran C Mathew

Brook Seaton

Teruo Sasagawa

Suryaprakash Ganti

John Batey

Zhanpeng Feng

Lior Kogut

Alan G Lewis

Avinash Venkata Uppuluri

Christopher Murphy

Denis H Endisch

Yeh-Jiun Tung

Chih-Wei Chiang

Chun-Ming Wang

John Le

James E Brooks

Nolan C Lerche

Stuart B Brown

Stephen Zee

Mark Todorovich

Wilhelmus Johannes Robertus Van Lier

Wonsuk Chung

Gaurav Sethi

Sauri Gudlavalleti

Charles Cameron Abnet

Amogh Subbakrishna Adishesha

Harshul Gupta

Jonghae Kim

Evgeni Petrovich Gousev

Matthew Michael Nowak

Je-Hsiung Lan

Ravindra Vaman Shenoy

Philip Don Floyd

Jonathan Charles Griffiths

Richard Alan Stewart

Nassim Khonsari

Hamood-Ur Rehman

Robert S Hastings

Andrew Pang

Himanshu Jain

Akshansh Chaudhry

Lakshay Sharma

Jodhvir Singh Chahal

Techniques for generating an arbitrary view of a scene from existing images are disclosed. In some embodiments, in response to receiving a request for an image comprising a desired perspective of a scene, the image comprising the desired perspective of the scene is generated using pixels obtained from a plurality of existing images having the desired perspective, wherein one or more of the plurality of existing images are transformed to the desired perspective from other perspectives.

Arbitrary view generation

Techniques associated with adaptive sampling are disclosed. In some embodiments, in response to receiving a specification of a scene to render, a sampling of each portion of the scene is determined based at least in part on the specification of the scene such that the scene is not uniformly sampled, and the scene is rendered according to the determined sampling of each portion of the scene.

Adaptive virtual camera sensor

A content generation platform is generally described herein. More specifically, interactive image generation and techniques and features thereof are disclosed herein. One or more sets of images of a scene are captured in an imaging studio. The captured one or more sets of images of the scene are processed using one or more machine learning based networks to generate an interactive image of the scene comprising a plurality of interactive features. One or more of the plurality of interactive features of the generated interactive image may be modified or edited according to user preferences.

Interactive image generation

Techniques for generating three-dimensional content from the recordings of one or more independently operated cameras that are not constrained to fixed positions and orientations are disclosed. In some embodiments, data associated with a camera recording a scene is received, wherein camera pose with respect to the scene is not known; camera pose with respect to the scene is determined based on received image data captured by the camera and received sensor data associated with the camera; and the received data and determined camera pose are used to facilitate generation of at least a portion of a point cloud corresponding to the scene.

Multi-camera 3D content creation

Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a rendering of an actual view of a scene as seen by a camera capturing the scene is obtained from existing assets associated with a virtualized version of the scene and displayed. The actual view of the scene comprises a known environment that includes one or more of a constrained set of objects. The rendering facilitates surfacing information associated with one or more objects comprising the actual view.

Blended physical and virtual realities

A machine learning based image processing architecture and associated applications are disclosed herein. In some embodiments, a machine learning framework is trained to learn low level image attributes such as object/scene types, geometries, placements, materials and textures, camera characteristics, lighting characteristics, contrast, noise statistics, etc. Thereafter, the machine learning framework may be employed to detect such attributes in other images and process the images at the attribute level.

Machine learning based image processing techniques

Two-dimensional compositing that preserves the curvatures of non-flat surfaces is disclosed. In some embodiments, a mapping is associated with a two-dimensional rendering that maps a potentially variable portion of the two-dimensional rendering to a canvas. The mapping is generated from a three-dimensional model of the potentially variable portion of the two-dimensional rendering. The potentially variable portion of the two-dimensional rendering is dynamically modified according to the mapping to reflect content comprising the canvas or edits received with respect to the canvas.

Two-dimensional compositing

Techniques for tagging virtualized content are disclosed. In some embodiments, a modeled three-dimensional scene of objects representing abstracted source content is generated and analyzed to determine a contextual characteristic of the scene that is based on a plurality of objects comprising the scene. The modeled scene is tagged with a tag specifying the determined contextual characteristic.

Tagging virtualized content

Techniques for machine learning based image attribute determination are disclosed. In some embodiments, one or more unknown attributes of a received image comprising a prescribed environment are determined using a machine learning based framework. The machine learning based framework is at least in part trained on image data sets comprising a model environment that substantially simulates the prescribed environment.

Machine learning based image attribute determination

Techniques for rendering a scene are disclosed. In some embodiments, a scene definition is modified to generate a modified scene definition based at least in part on a current state of a local database at a device. The modified scene definition is constrained to include references to objects locally available in the local database, and at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database. The scene is rendered at the device according to the modified scene definition.

Rendering a modeled scene

Techniques for generating aligned, augmented reality views are disclosed. In some embodiments, an estimate of a floorplan of a three-dimensional space is first generated based on one or more received views of the three-dimensional space from a camera located in the three-dimensional space. A camera pose of the camera in the three-dimensional space is next determined based on generating a corrected floorplan from the estimate of the floorplan based on foreknowledge associated with the floorplan. Display of a rendering having the determined camera pose is facilitated in an actual view of the camera, resulting in an aligned, augmented reality view.

Aligned augmented reality views

Techniques for delivering virtualized content are disclosed. In some embodiments, elements in source content are mapped to a set of corresponding database objects, and the set of database objects is modified to generate a virtualized version of the source content. A specification of the virtualized version of the source content is provided to an output device in response to a request from the output device for the source content.

Delivering virtualized content

Growing community of inventors

San Mateo, CA, United States of America

Clarence Chui