Apple Inc.

University of Minnesota

Flyby Media, Inc.

Oriel Bergig

Andriy Grygorenko

Oleg Naroditsky

Alex Flint

Netanel Hagbi

Stergios I Roumeliotis

Jihad A Elsana

Christopher P Broaddus

Moshe Laifenfeld

Gregory Guyomarc'h

Jonathan Hauser

Jason R Holloway

Yoed Arieli

Christopher Broaddus

Dan Nussinson

Connor Henley

Alexandra H Chau

Imaging apparatus includes a camera, which includes an autofocus mechanism. A range sensor includes a transmitter, which includes multiple emitters configured to transmit optical pulses at different angles toward the scene, and a receiver, to receive and sense respective times of flight of the optical pulses that are reflected from the scene. A photodetector outputs a signal indicative of an intensity of reflections from the scene. Control circuitry drives the emitters in alternation to transmit the optical pulses, estimates a range to a target in the scene responsively to the times of flight sensed by the receiver, detects a difference in the signal output by the photodetector in response to the pulses transmitted by different ones of the emitters, and sets the autofocus mechanism responsively to the estimated range as long as the detected difference is no greater than a predefined threshold difference.

Detection of close-range specular targets

In some examples, an electronic device may be in communication with one or more input devices, including a camera, and a remote sensing vibrometer. In some examples, the remote sensing vibrometer may be configurable to emit, using a light source, one or more light beams that are incident on the physical surface on which the virtual image is displayed. In some examples, the remote sensing vibrometer detects contact with the physical surface based on one or more vibrations in the physical surface that are detected using the one or more light beams. In some examples, when the physical object contacts the physical surface on which the virtual image is displayed, the electronic device determines a location of the contact relative to the virtual image on the physical surface based on the detected vibrations produced by the contact of the physical object on the physical surface in the computer-generated environment.

System and method of tap detection on a three-dimensional image

A method of creating a local map includes: receiving, at a mobile electronic data processing apparatus, a request from a server to generate a map of a specified destination; sending to the server a message accepting the request to generate the map responsive to receiving, at a user input of the mobile electronic data processing device, a user command indicating acceptance of the request; generating, using a processor, information related to construction of the map; an transmitting, from the mobile electronic data processing apparatus, the information related to construction of the map.

Localized map generation

A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.

Visual-based inertial navigation

Disclosed are systems and methods for compositing an augmented reality scene, the methods including the steps of extracting, by an extraction component into a memory of a data-processing machine, at least one object from a real-world image detected by a sensing device; geometrically reconstructing at least one virtual model from at least one object; and compositing AR content from at least one virtual model in order to augment the AR content on the real-world image, thereby creating AR scene. Preferably, the method further includes; extracting at least one annotation from the real-world image into the memory of the data-processing machine for modifying at least one virtual model according to at least one annotation. Preferably, the method further includes: interacting with AR scene by modifying AR content based on modification of at least one object and/or at least one annotation in the real-world image.

Method and system for compositing an augmented reality scene

The present system provides an on the fly simple to complex 6DOF registration approach using the direct method. On the fly means it does not require training time, a user points a phone/camera to a planar surface and can start tracking it instantly. Simple to complex means the system performs registration in multiple levels of complexity from 2DOF to 6DOF. By increasing the complexity model the system enables more surfaces to be tracked and for surfaces that are tracked the system can avoid local minima solution providing a more robust and accurate 6DOF tracking. Even surfaces that are very weak in features can be tracked in 6DOF and virtual content can be registered to them. The system enables playing Augmented Reality games on low-end devices such as mobile phones on almost any surface in the real world.

Systems and methods for efficient 3D tracking of weakly textured planar surfaces for augmented reality applications

The present disclosure relates to systems and methods for tracking planar shapes for augmented-reality (AR) applications. Systems for real-time recognition and camera six degrees of freedom pose-estimation from planar shapes are disclosed. Recognizable shapes can be augmented with 3D content. Recognizable shapes can be in form of a predefined library being updated online using a network. Shapes can be added to the library when the user points to a shape and asks the system to start recognizing it. The systems perform shape recognition by analyzing contour structures and generating projective invariant signatures. Image features are further extracted for pose estimation and tracking. Sample points are matched by evolving an active contour in real time.

Growing community of inventors

D.N. Lachis, Israel

Oriel Bergig