Qualcomm Incorporated

Hewlett-packard Development Company, L.P.

Vikas Ramachandra

Kalin Mitkov Atanassov

Sergiu Radu Goma

James Wilson Nash

Milivoje M Aleksic

Evgeni Petrovich Gousev

Russell Wayne Gruhlke

Ruben Manuel Velarde

Hasib Siddiqui

Albrecht Johannes Lindner

Khurshid Syed Alam

Thomas Wesley Osborne

Andrew J Patti

John Michael Wyrwas

Robert Mitchell Kleiman

Systems and methods for correcting stereo yaw of a stereoscopic image sensor pair using autofocus feedback are disclosed. A stereo depth of an object in an image is estimated from the disparity of the object between the images captured by each sensor of the image sensor pair. An autofocus depth to the object is found from the autofocus lens position. If the difference between the stereo depth and the autofocus depth is non zero, one of the images is warped and the disparity is recalculated until the stereo depth and the autofocus depth to the object is substantially the same.

Stereo yaw correction using autofocus feedback

Methods and apparatus for sharing a bus between multiple imaging sensors, include, in some aspects, a device having at least two imaging sensors, an electronic hardware processor, and an imaging sensor controller. The imaging sensor controller includes first clock and data lines, operably coupling the electronic hardware processor to the imaging sensor controller, and a second clock line, operably coupling the imaging sensor controller to the first imaging sensor and the second imaging sensor. A second data line operably couples the imaging sensor controller to the first imaging sensor. A third data line operably couples the sensor controller to the second imaging sensor. The imaging sensor controller is configured to use the second clock line, and second data line to send a first command to the first imaging sensor, and, use the second clock line, and third data line to send a second command to the second imaging sensor.

Method and apparatus for bus sharing by multiple imaging sensors

An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.

Large area interactive display screen

A structured light three-dimensional (3D) depth map based on content filtering is disclosed. In a particular embodiment, a method includes receiving, at a receiver device, image data that corresponds to a structured light image. The method further includes processing the image data to decode depth information based on a pattern of projected coded light. The depth information corresponds to a depth map. The method also includes performing one or more filtering operations on the image data. An output of the one or more filtering operations includes filtered image data. The method further includes performing a comparison of the depth information to the filtered image data and modifying the depth information based on the comparison to generate a modified depth map.

Structured light three-dimensional (3D) depth map based on content filtering

Described herein are methods and apparatus to adjust the convergence point of a stereoscopic image pair captured by an imaging device. In one method, a first image and a second image of a stereoscopic image pair are provided, and then shifting or cropping of the first image is performed to align the first and second image. This shifting or cropping is performed while preserving the second image. The method then includes determining a target horizontal image disparity based on a desired convergence point of the stereoscopic image pair and when the target horizontal disparity is greater than a predetermined maximum, the cropping of an outside dimension of the first image is limited. In some implementations it is limited to the predetermined maximum.

Methods and apparatus for improved cropping of a stereoscopic image pair

Techniques are described for determining a contact location on a touch screen panel. The techniques transmit an optical signal that includes digital bits through the touch screen, and determine for which digital bits the optical power level reduced. Based on the determined digital bits, the techniques determine the contact location on the touch screen panel.

Touch screen panel using digitally encoded light

Present embodiments contemplate systems, apparatus, and methods to determine an appropriate focal depth for a sensor based upon a pair of stereoscopic images. Particularly, certain of the embodiments contemplate determining keypoints for each image, identifying correlations between the keypoints, and deriving object distances from the correlations. These distances may then be used to select a proper focal depth for one or more sensors.

Autofocus for stereo images

A method operational on a receiver device for decoding a codeword is provided. At least a portion of a composite code mask is obtained, via a receiver sensor, and projected on the surface of a target object. The composite code mask may be defined by a code layer and a carrier layer. A code layer of uniquely identifiable spatially-coded codewords may be defined by a plurality of symbols. A carrier layer may be independently ascertainable and distinct from the code layer and may include a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may have been pre-shaped by a synthetic point spread function prior to projection. The code layer may be adjusted, at a processing circuit, for distortion based on the reference objects within the portion of the composite code mask.

Reception of affine-invariant spatial mask for active depth sensing

Described herein are methods, systems and apparatus to improve imaging sensor production yields. In one method, a stereoscopic image sensor pair is provided from a manufacturing line. One or more images of a correction pattern are captured by the image sensor pair. Correction angles of the sensor pair are determined based on the images of the correction pattern. The correction angles of the sensor pair are represented graphically in a three dimensional space. Analysis of the graphical representation of the correction angles through statistical processing results in a set of production correction parameters that may be input into a manufacturing line to improve sensor pair yields.

System and method for improving methods of manufacturing stereoscopic image sensors

Described are methods and apparatus for adjusting images of a stereoscopic image pair. The methods and apparatus may capture a first and second image with first and second imaging sensors. The two imaging sensors have intrinsic and extrinsic parameters. A normalized focal distance of a reference imaging sensor may also be determined based on intrinsic and extrinsic parameters. A calibration matrix is then adjusted based on the normalized focal distance. The calibration matrix may be applied to an image captured by an image sensor.

Method and apparatus for calibrating an imaging device

A method operational on a transmitter device is provided for projecting a composite code mask. A composite code mask on a tangible medium is obtained, where the composite code mask includes a code layer combined with a carrier layer. The code layer may include uniquely identifiable spatially-coded codewords defined by a plurality of symbols. The carrier layer may be independently ascertainable and distinct from the code layer and includes a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may be pre-shaped by a synthetic point spread function prior to projection. At least a portion of the composite code mask is projected, by the transmitter device, onto a target object to help a receiver ascertain depth information for the target object with a single projection of the composite code mask.

Transmission of affine-invariant spatial mask for active depth sensing

A method for generating codes for a code mask is provided. A plurality of symbols may be arranged into an n1 by n2 symbol structure, where n1 and n2 are integer values. A plurality of codewords may be defined from different overlapping k1 by k2 windows within the symbol structure, wherein co-linear and spatially overlapping windows define unique codewords, and the codewords are unique in a first direction of the symbol structure but are repeated in a second direction that is perpendicular to the first direction. A plurality of the symbol structures as a code mask, wherein symbols in two adjacent k1 by k2 windows are selected so as to avoid codeword aliasing of codewords in the two adjacent k1 by k2 windows.

Code in affine-invariant spatial mask

Compressed frames of a video with associated reduced information about an object are received. The video has unreduced information about an object moving with respect to boundaries that are fixed with in each frame of the video and the compressed frames have reduced information about the object moving with respect to the boundaries that are fixed with in each of the compressed frames. The reduced information has quantization error due to compression. An estimate of the unreduced information is created by transforming the reduced information into the estimate using computer implemented motion estimation. The estimate has less quantization error than the reduced information.

Growing community of inventors

San Diego, CA, United States of America

Vikas Ramachandra