Apple Inc.

Primesense Ltd

Aviad Maizels

Alexander Shpunt

Zeev Zalevsky

Javier Garcia

Tamir Berliner

Eran Guendelman

Shai Litvak

Ziv Hendel

Oz Magal

Sergio Golman

Jonathan Pokras

Operating a computerized system includes presenting user interface elements on a display screen. A first gesture made in a three-dimensional space by a by a distal portion of an upper extremity of a user is detected while a segment of the distal portion thereof rests on a surface. In response to the first gesture, an area of the display screen selected by the user is identified, and a corresponding user interface element is displayed. After displaying the corresponding user interface element, a second gesture made by the distal portion is detected while the segment continues to rest on the surface so as to select one of the user interface elements that appears in the selected area.

Enhanced 3D interfacing for remote devices

A system for object reconstruction includes an illuminating unit, comprising a light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.

Method and system for object reconstruction

Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera and a 3-dimensional camera, associated depth projector and content projector, and a processor linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures.

Adaptive projector for projecting content into a three-dimensional virtual space

A system for object reconstruction includes an illuminating unit, comprising a coherent light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.

A system and method are presented for use in the object reconstruction. The system comprises an illuminating unit, and an imaging unit (see FIG.). The illuminating unit comprises a coherent light source and a generator of a random speckle pattern accommodated in the optical path of illuminating light propagating from the light source towards an object, thereby projecting onto the object a coherent random speckle pattern. The imaging unit is configured for detecting a light response of an illuminated region and generating image data. The image data is indicative of the object with the projected speckles pattern and thus indicative of a shift of the pattern in the image of the object relative to a reference image of said pattern. This enables real-time reconstruction of a three-dimensional map of the object.

An apparatus for processing data includes a projector, which is configured to project content onto at least a part of a scene. A processor is configured to detect a location of an eye of a person in the scene and to control the projector so as to reduce an intensity of the projected content in an area of the eye.

Adaptive projector

Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera () and a 3-dimensional camera (), associated depth projector and content projector (), and a processor () linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures.

Interactive reality augmentation for natural interaction

A user interface method includes defining an interaction surface containing an interaction region in space. A sequence of depth maps is captured over time of at least a part of a body of a human subject. The depth maps are processed in order to detect a direction and speed of movement of the part of the body as the part of the body passes through the interaction surface. A computer application is controlled responsively to the detected direction and speed.

Growing community of inventors

Tel Aviv, Israel

Aviad Maizels