Apple Inc.

Primesense Ltd

Tamir Berliner

Jonathan Pokrass

Eyal Bychkov

Amir Hoffnung

Micha Galor

Ofir Or

Oren Brezner

Alexander Shpunt

Aviad Maizels

Ziv Hendel

Eran Guendelman

Jeffrey Danowitz

Dmitri Rais

Oren Mor

Michael Shpigelmacher

Oz Magal

Sergio Golman

Jonathan Pokras

A method, including receiving a three-dimensional (3D) map of at least a part of a body of a user () of a computerized system, and receiving a two dimensional (2D) image of the user, the image including an eye () of the user. 3D coordinates of a head () of the user are extracted from the 3D map and the 2D image, and a direction of a gaze performed by the user is identified based on the 3D coordinates of the head and the image of the eye.

Gaze detection in a 3D mapping environment

A method includes receiving a sequence of three-dimensional (3D) maps of at least a part of a body of a user of a computerized system and extracting, from the 3D map, 3D coordinates of a head of the user. Based on the 3D coordinates of the head, a direction of a gaze performed by the user and an interactive item presented in the direction of the gaze on a display coupled to the computerized system are identified. An indication is extracted from the 3D maps an indication that the user is moving a limb of the body in a specific direction, and the identified interactive item is repositioned on the display responsively to the indication.

Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera and a 3-dimensional camera, associated depth projector and content projector, and a processor linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures.

Adaptive projector for projecting content into a three-dimensional virtual space

A method includes receiving an image including an eye of a user of a computerized system and identifying, based the image of the eye, a direction of a gaze performed by the user. Based on the direction of the gaze, a region on a display coupled to the computerized system is identified, an operation is performed on content presented in the region.

Gaze-based display control

A method includes receiving and segmenting a first sequence of three-dimensional (3D) maps over time of at least a part of a body of a user of a computerized system in order to extract 3D coordinates of a first point and a second point of the user, the 3D maps indicating a motion of the second point with respect to a display coupled to the computerized system. A line segment that intersects the first point and the second point is calculated, and a target point is identified where the line segment intersects the display. An interactive item presented on the display in proximity to the target point is engaged.

Pointing-based display interaction

An apparatus for processing data includes a projector, which is configured to project content onto at least a part of a scene. A processor is configured to detect a location of an eye of a person in the scene and to control the projector so as to reduce an intensity of the projected content in an area of the eye.

Adaptive projector

Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera () and a 3-dimensional camera (), associated depth projector and content projector (), and a processor () linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures.

Interactive reality augmentation for natural interaction

A method includes receiving, from a three-dimensional (3D) sensing device coupled to a computer, a sequence of 3D maps including at least part of a hand of a user positioned in proximity to the computer. In embodiments of the present invention, the computer is coupled to one or more peripheral devices, and upon identifying, in the sequence of 3D maps, a movement of the hand toward a given peripheral device, an action preparatory to disengaging the given peripheral device is initiated.

Detecting user intent to remove a pluggable peripheral device

A computer-implemented method includes receiving a depth map () of a scene containing a body of a humanoid subject (). The depth map includes a matrix of pixels (), each corresponding to a respective location in the scene and having a respective pixel value indicative of a distance from a reference location to the respective location. The depth map is segmented so as to find a contour () of the body. The contour is processed in order to identify a torso () and one or more limbs () of the subject. An input is generated to control an application program running on a computer by analyzing a disposition of at least one of the identified limbs in the depth map.

Modeling of humanoid forms from depth maps

A user interface method includes defining an interaction surface containing an interaction region in space. A sequence of depth maps is captured over time of at least a part of a body of a human subject. The depth maps are processed in order to detect a direction and speed of movement of the part of the body as the part of the body passes through the interaction surface. A computer application is controlled responsively to the detected direction and speed.

Growing community of inventors

Beit Hashmonay, Israel

Tamir Berliner