Google Inc.

Electronic Arts Inc.

Mark Dochtermann

Tarik Abdel-Gawad

Douglas Muir

Ivan Neulander

Alan Joyce

Brian M Collins

Diane Wang

Jay Steele

Bryan Woods

Paulo Coelho

Samantha Raja

Drew Skillman

Ashley Pinnick

Steven Toh

David Bond

Paul Keet

Jason Quinn Gregory

Matthew Gilgenbach

Jackson Lango

Suddhasattwa Bose

An electronic device places an augmented reality object in an image of a real environment based on a pose of the electronic device and based on image segmentation. The electronic device includes a camera that captures images of the real environment and sensors, such as an inertial measurement unit (IMU), that capture a pose of the electronic device. The electronic device selects an augmented reality (AR) object from a memory, segments a captured image of the real environment into foreground pixels and background pixels, and composites an image for display wherein the AR object is placed between the foreground pixels and the background pixels. As the pose of the electronic device changes, the electronic device maintains the relative position of the AR object with respect to the real environment in images for display.

Placing augmented reality objects in an image based on device position

Disclosed are various embodiments for selecting augmenting reality (AR) objects based on contextual cues associated with an image captured by a camera associated with electronic device. Contextual cues are obtained at an electronic device and AR objects are identified from a memory associated with the electronic device. The electronic device implements a processor employing image segmentation techniques to combine the identified AR objects with the captured image and render the combined image for display at a display associated with the electronic device.

Selecting augmented reality objects for display based on contextual cues

Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.

Illumination effects from luminous inserted content

In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

Interaction system for augmented reality objects

Multiple instances of a single object are aggregated and submitted collectively to a graphics API for rendering. Vertices of the object are replicated into a large buffer and are modified so as to be bound to different transformation matrices in a matrix palette. An index buffer of the object is similarly replicated. Each replicated index buffer is modified to refer to vertices of a different, respective set of replicated vertices. Thus, the large vertex and index buffers are initialized to contain multiple, distinct, and independent copies of the object. Instancing logic aggregates matrix palettes of individual instances of the same object into an aggregated matrix palette and sends the aggregated vertex and index buffers of the object along with the accumulated aggregated matrix palette to the graphics API for rendering. The graphics API resolves the aggregated vertex and index buffers and matrix palette to a collection of triangles in display coordinates to be rasterized, not knowing or caring that the collection of triangles represent not one object but many objects.

Efficient rendering of similar objects in a three-dimensional graphics engine

Growing community of inventors

Sherman Oaks, CA, United States of America

Mark Dochtermann