Apple Inc.

Daniel C Byrnes

Stergios I Roumeliotis

Oleg Naroditsky

Kuen-Han Lin

Shuntaro Yamazaki

Connie Wu

Ravi Teja Sukhavasi

Methods for performing a calibration process for outward-facing cameras on devices such as head-mounted display devices are disclosed. Extrinsic parameters of the camera are first estimated using inputs to the calibration process such as information from an inertial measurement unit and points of interest within images captured by the camera that are tracked with time. Then, extrinsic and intrinsic parameters are concurrently determined in an optimization problem such that updated values of said parameters may be stored and used by applications that run on the device and make use of the camera. The calibration process may be extended to concurrently calibrate multiple cameras based, at least in part, on information from the inertial measurement unit that is local to the camera.

Methods for infield camera calibrations

Various implementations disclosed herein include devices, systems, and methods that localize a device based on detecting planes in depth data acquired by the device. For example, an example process may include detecting first plane data in first sensor data acquired by a sensor at a first viewpoint location in a physical environment, detecting second plane data in second sensor data acquired by the sensor at a second viewpoint location in the physical environment, determining that the first plane data and the second plane data correspond to a same plane based on comparing the first plane data with the second plane data, and determining a spatial transformation between the first viewpoint location and the second viewpoint location based on the first plane data and the second plane data.

Plane extraction and localization

Growing community of inventors

Redwood City, CA, United States of America

Daniel C Byrnes