Facebook Technologies, LLC

Oculus, Vr, LLC

Maksym Katsev

Neil Konzen

Dov Katz

Michael Antonov

Robin Michael Miller

Oskar Linde

Steve LaValle

John Enders Robertson

Jonathan Shine

Steven LaValle

Steve Lavalle

An imaging device captures images of a head-mounted display (HMD), or other object, including locators providing a pattern of light. The imaging device compresses captured images of the locators of the HMD by identifying pixels of a captured image having at least a threshold brightness and additional pixels within a threshold distance of the identified pixels. To generate a compressed image, the camera performs run-length encoding of pixels other than the identified pixels and additional pixels. The compressed image is provided by the imaging device to a console or other computing device. In some embodiments, the imaging device also determines whether a segment of adjacent pixels in a captured image is above the threshold brightness and sets the segment of adjacent pixels to a specific value and performs run-length encoding on the segment of adjacent pixels above the threshold brightness.

Compression of captured images including light captured from locations on a device or object

A virtual reality (VR) system tracks the position of a controller. The VR system includes an image tracking system comprising of a number of fixed cameras, and a headset worn by the user that includes an imaging device to capture images of a controller operated by the user. The controller includes a set of features disposed on the surface of the controller. The image tracking system provides a first view of the controller. The imaging device mounted on the headset provides a second view of the controller. Each view of the controller (i.e., from the headset and from the image tracking system) provides a distinct set of features observed on the controller. The first and second sets of features are identified from the captured images and a pose of the controller is determined using the first set of features and the second set of features.

Tracking controllers of a virtual reality system

A virtual reality (VR) console receives slow calibration data from an imaging device and fast calibration data from an inertial measurement unit on a virtual reality headset. Using a model of the VR headset, the VR console identifies model locators corresponding to locators on the VR headset and generates estimated positions for locators included in slow calibration data. The VR console adjusts calibration parameters so a relative distance between estimated positions of the locators and positions of their corresponding model locators is less than a threshold value. From the estimated positions, the VR console generates calibrated positions of a reference point on the VR headset associated with images from the slow calibration data. The VR console determines predicted positions of the reference point from the calibrated positions and adjusts calibration parameters so intermediate estimated positions of the reference point are within a threshold distance of the predicted positions.

Calibration of virtual reality systems

Growing community of inventors

Los Altos, CA, United States of America

Maksym Katsev