Proprio, Inc.

Microvision, Inc.

Thomas Ivan Nonn

James Andrew Youngquist

Adam Gabriel Jones

David Julio Colmenares

Jay Peterson

Jonathan A Morarity

Alga Lloyd Nothern, Iii

Sumit Sharma

Nava Aghdasi

Tze-Yuan Cheng

Arun K Paruchuri

Methods and systems for calibrating an imaging system having a plurality of sensors are disclosed herein. In some embodiments, a method includes initially calibrating the imaging system, operating the imaging system during an imaging procedure, and then updating the calibration during the imaging procedure to account for degradation of the initial calibration due to environmental factors, such as heat. The method of updating the calibration can include capturing image data of a rigid body having a known geometry with the sensors and determining that the calibration has drifted for a problematic one of the sensors based on the captured image data. After determining the problematic one of the sensors, the method can include updating the calibration of the problematic one of the sensors based on the captured image data.

Methods and systems for calibrating and/or verifying a calibration of an imaging system such as a surgical imaging system

Camera arrays for mediated-reality systems and associated methods and systems are disclosed herein. In some embodiments, a camera array includes a support structure having a center, and a depth sensor mounted to the support structure proximate to the center. The camera array can further include a plurality of cameras mounted to the support structure radially outward from the depth sensor, and a plurality of trackers mounted to the support structure radially outward from the cameras. The cameras are configured to capture image data of a scene, and the trackers are configured to capture positional data of a tool within the scene. The image data and the positional data can be processed to generate a virtual perspective of the scene including a graphical representation of the tool at the determined position.

Methods and systems for imaging a scene, such as a medical scene, and tracking objects within the scene

Methods for selecting pairs of cameras in a multicamera array configured to image a scene to generate stereoscopic views, and associated systems and devices, are disclosed herein. In some embodiments, a representative method includes selecting a pair of cameras in the multicamera array from which to generate a stereoscopic view, and receiving images of the scene from the selected pair of the cameras. The method further includes cropping the images based on a known calibration of the cameras and a desired disparity, and displaying the cropped images on a display device to generate the stereoscopic view. The desired disparity can correspond to an interpupillary distance of a user.

Methods for generating stereoscopic views in multicamera systems, and associated devices and systems

Methods of determining the depth of a scene and associated systems are disclosed herein. In some embodiments, a method can include augmenting depth data of a scene captured with a depth sensor with depth data from one or more images of the scene. For example, the method can include capturing image data of the scene with a plurality of cameras. The method can further include generating a point cloud representative of the scene based on the depth data from the depth sensor and identifying a missing region of the point cloud, such as a region occluded from the view of the depth sensor. The method can then include generating depth data for the missing region based on the image data. Finally, the depth data for the missing region can be merged with the depth data from the depth sensor to generate a merged point cloud representative of the scene.

Methods and systems for augmenting depth data from a depth sensor, such as with data from a multiview camera system

Endoscopic imaging systems are disclosed herein. In some embodiments, an endoscopic imaging system can include an endoscope having a distal tip with a distal face configured to face a scene, such as a portion of a body cavity of a patient. The endoscope can further include first cameras for capturing first image data of the scene, a projector for projecting a light pattern into the scene, and second cameras for capturing second image data of the scene including the light pattern. A processor can be communicatively coupled to the first and second cameras for receiving the first and second image data. The processor can process the first and second image data to generate an image of the scene at the perspective of a virtual camera, and can vary the perspective, the aperture, the focus plane, and/or another parameter of the virtual camera without requiring the endoscope to be physically moved.

Endoscopic imaging systems for generating three dimensional images, and associated systems and methods

Systems, devices, and methods for collection, editing, and playback of data collected from an imaging system for generating a virtual perspective of a scene are disclosed. In one example perspective, an imaging system includes a camera array configured to capture multiple images of a scene. Each of the multiple images includes color data represented in a Bayer pattern that includes a blue channel, two green channels, and a red channel. The system also includes an image processing device configured to receive the multiple images captured by the camera array, split each of the multiple images represented in the Bayer pattern into four individual color planes, form at least one set of data by combining the four individual color planes of the multiple images, and compress the at least one set of data.

Light field capture, compression, transmission and reconstruction

A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Adaptive methods dynamically modify the size and location of the field of view as well as laser pulse properties in response to internal and external sensors data.

Adaptive LIDAR scanning methods

A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Scanning mirror offsets may be applied to modify a fan angle of the pulsed fanned laser beam. Adaptive methods dynamically modify the size and location of the field of view, laser pulse properties, and/or fan angle in response to internal and external sensors data.

LIDAR system with spatial beam combining

A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. A phase offset may be injected into a scanning trajectory to mitigate effects of interfering light sources.

Growing community of inventors

Kenmore, WA, United States of America

Thomas Ivan Nonn