Outward, Inc.

Brook Seaton

Clarence Chui

Manu Parmar

Akshansh Chaudhry

Lakshay Sharma

Himanshu Jain

A content generation platform is generally described herein. More specifically, interactive image generation and techniques and features thereof are disclosed herein. One or more sets of images of a scene are captured in an imaging studio. The captured one or more sets of images of the scene are processed using one or more machine learning based networks to generate an interactive image of the scene comprising a plurality of interactive features. One or more of the plurality of interactive features of the generated interactive image may be modified or edited according to user preferences.

Interactive image generation

Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a rendering of an actual view of a scene as seen by a camera capturing the scene is obtained from existing assets associated with a virtualized version of the scene and displayed. The actual view of the scene comprises a known environment that includes one or more of a constrained set of objects. The rendering facilitates surfacing information associated with one or more objects comprising the actual view.

Blended physical and virtual realities

Techniques for generating aligned, augmented reality views are disclosed. In some embodiments, an estimate of a floorplan of a three-dimensional space is first generated based on one or more received views of the three-dimensional space from a camera located in the three-dimensional space. A camera pose of the camera in the three-dimensional space is next determined based on generating a corrected floorplan from the estimate of the floorplan based on foreknowledge associated with the floorplan. Display of a rendering having the determined camera pose is facilitated in an actual view of the camera, resulting in an aligned, augmented reality view.

Aligned augmented reality views

Techniques for generating an arbitrary view or perspective of an ensemble scene are disclosed. In some embodiments, in response to a received request for a prescribed perspective of an ensemble scene comprising a plurality of assets, an output image of the ensemble scene for the requested prescribed perspective is generated based at least in part on combining at least a portion of an existing image of each of at least a subset of the plurality of assets.

Arbitrary view generation

Techniques for generating a prescribed perspective of a scene are disclosed. In some embodiments, a specification of a scene comprising a plurality of objects is specified using object views that are substantially free of perspective distortions, and a prescribed perspective of the scene is at least in part generated by populating the prescribed perspective of the scene with pixels from existing images of the plurality of objects.

Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a pose of a camera of a device located in a venue is determined based at least in part on three-dimensional asset recognition in a field of view of the camera, wherein the field of view of the camera comprises an actual physical view of the venue; a virtual view corresponding to the actual view is obtained from existing assets comprising a specification of a virtualized version of the venue; and display of the virtual view is facilitated at the venue. Thus, a virtual reality of a physical space is provided while at the physical space based on actual three-dimensional objects detected or recognized in the physical space.

Techniques for generating an arbitrary perspective of a composite object are disclosed. In some embodiments, a specification of an orthographic view of a composite object comprises combined orthographic views of a plurality of objects, and an arbitrary perspective of the composite object is at least in part generated by populating the arbitrary perspective of the composite object with pixels harvested from existing images of the plurality of objects.

Techniques for generating aligned, augmented reality views are disclosed. In some embodiments, an estimate of a floorplan of a three-dimensional space is first generated based on one or more views of the three-dimensional space from a camera of a device located in the three-dimensional space. A cost function is next minimized with respect to the estimate of the floorplan to generate a corrected floorplan having less error than the estimated floorplan, and a camera pose corresponding to the corrected floorplan is determined. Display of a rendering having the determined camera pose is facilitated in an actual view of the camera, resulting in an aligned, augmented reality view.

Techniques for generating an arbitrary ensemble view from a plurality of other existing views are disclosed. In some embodiments, arbitrary view generation comprises retrieving a set of views corresponding to each of a plurality of objects, transforming the set of views of each of the plurality of objects to a requested perspective, and generating an ensemble view comprising the plurality of objects that has the requested perspective by combining pixels from the transformed sets of views of the plurality of objects.

Growing community of inventors

Oakland, CA, United States of America

Brook Seaton