Orbbec Inc.

Shenzhen Orbbec Co., Ltd.

Yuanhao Huang

Zhenzhong Xiao

Xu Chen

Xing Xu

Xiaolu Mei

Zhaomin Wang

Honghuai Xu

Long Po Liu

Lianghong Zhong

Min Yan

Sheng Xu

Peng Yang

Chengyu Zhang

Fuyang Lan

A method for correcting interference fringes includes: obtaining interference fringe images with different photographing distances; obtaining a to-be-corrected image including to-be-corrected pixels, and calculating a depth value of each to-be-corrected pixel in the to-be-corrected image; selecting, from the interference fringe images with different photographing distances, an interference fringe image corresponding to the depth value of each to-be-corrected pixel as a target interference fringe image; extracting first pixel values of target coordinate positions in the target interference fringe image; and correcting second pixel values of to-be-corrected pixels according to the first pixel values corresponding to the to-be-corrected pixels to obtain a corrected image.

Image correction method, and under-screen system

A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns, and the image patterns are rotated by an angle such that edges of the image patterns are not in parallel with a baseline between the structured light projection module and a capture module.

Structured light projection module, depth camera, and method for manufacturing structured light projection module

A depth image engine and a depth image calculation method are provided. The depth image engine comprises: a buffer, configured to receive a data flow of a first image; an image rotator, configured to perform, after the buffer receives the entire data flow of the first image, a rotation operation on the first image to generate a second image; and a depth value calculator, configured to receive the second image and a reference image to perform a matching calculation on the second image and the reference image to generate a depth image.

Depth image engine and depth image calculation method

A depth calculation processor includes: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.

Depth calculation processor and mobile terminal

A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: at least two input ports configured to receive a first image data, wherein the first image data comprises at least a structured light image acquired under projection of a structured light; a data processing engine configured to perform a calculation process on the first image data to output a second image data, wherein the second image data comprises at least a depth map, wherein the data processing engine comprises at least a depth processing engine configured to perform a depth calculation process on the structured light image to obtain the depth map; and at least an output port coupled to the data processing engine and configured to output the second image data to a host device.

Depth calculation processor, data processing method and 3D image device

A depth calculation processor comprises: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.

The present application provides an identity authentication method and an apparatus. The method may include obtaining a sequence of depth images containing a target face and a sequence of original two-dimensional (2D) images containing the target face, and performing identity authentication. The identity authentication may be conducted by: calculating a target face three-dimensional (3D) texture image according to the depth images containing the target face and the original 2D images containing the target face; projecting the target face 3D texture image to a 2D plane to obtain a target face 2D image; extracting feature information from the target face 2D image; comparing the feature information of the target face 2D image with feature information of a reference face 2D image to determine a similarity value; and in response to that the similarity value exceeds a first threshold, determining that the identity authentication succeeds.

3D face identity authentication method and apparatus

A diffractive optical element is configured to receive a first patterned light beams, and diffracts the first patterned light beams to project a second patterned light beam outwardly. The second patterned light beam is formed of combined arrangement of a plurality of first patterned light beams, and the combined arrangement includes periodic arrangement in a first direction and a second direction. The first direction and the second direction are not perpendicular to each other. By designing the performance of the diffractive optical element, the outwardly projected structured light pattern is periodically arranged in two directions, and the two directions are not perpendicular to each other, such that spot patterns are highly unrelated in multiple directions, improving accuracy.

Structured light projection module for projecting unrelated patterns

A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns. Relationships between adjacent image patterns of the plurality of image patterns comprise at least two of an overlapping relationship, an adjoining relationship, and a spacing relationship. The structured light projection module can project speckle patterns having a high degree of irrelevance.

A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: two input ports to receive a first image data, wherein the first image data comprises structured light image acquired under projection of structured light; an input switch connected to the input ports and to convey all or some of the first image data from the input ports; a data processing engine connected to the input switch and to process the first image data that is output through the input switch and to output a second image data, wherein the second image data comprises a depth map, wherein the data processing engine comprises a depth processing engine to process the structured light image to obtain the depth map; and one output port connected to the data processing engine and to output the second image data to a main device.

The present invention discloses a television virtual touch control method and system. The television virtual touch control method is used in a television having a depth camera and includes the following steps: acquiring a human body image having depth information by the depth camera in real time; presetting an area excluding a hand area in a human body area as a reference area; extracting the depth information of the reference area and the hand area from the human body image; defining a virtual touch surface between the depth camera and the reference area at a first predetermined distance D1 from the reference area; and determining whether the hand area touches or penetrates through the virtual touch surface according to the depth information of the hand area, the depth information of the reference area and the first predetermined distance D1. The present invention has the beneficial effects of improving touch sensitivity and enhancing user experience.

Television virtual touch control method and system

The present disclosure relates to a full-field Z-direction displacement measurement system. Dynamic measurement is achieved on the basis of laser shearing speckle interferometry by using a spatial domain phase shift method. The homogeneity and similar measurement accuracy of the laser shearing speckle interferometry and the Doppler interferometry are further used to help the laser shearing speckle interferometry to implement absolute displacement measurement by using the single-point time domain Doppler interferometry. By means of the improvements in these aspects, the measurement system of the present invention can achieve full-field Z-direction displacement measurement, high-precision full-field absolute value vibration measurement and transient depth measurement, and can have important applications in depth measurement, three-dimensional sensing, vibration measurement in aerospace and the depth measurement in new material characterization detection and other fields.

Overall Z-direction displacement measuring system

The present invention relates to a human body model acquisition method and a virtual network fitting system based on depth cameras. The method includes the following steps: step S1: generating mark points covering a model body surface and used for determining features of the model body surface on the model body surface, meanwhile collecting depth images of the model body from a plurality of angles by using the depth cameras to acquire a depth image sequence that covers the model body surface and contains the mark points; step S2: carrying target depth information point cloud grid reconstruction on frames of depth images in the depth image sequence; and step S3: mosaicing the reconstructed frames of depth images into a three-dimensional model of the model body according to the mark points in the reconstructed frames of depth images. Compared with the prior art, by adopting the human body model acquisition method and the virtual network fitting system based on the depth cameras provided by the present invention, the accurate three-dimensional human body model and the accurate three-dimensional garment model can be acquired, and virtual fitting is carried out accordingly to acquire a real fitting effect.

Depth camera-based human-body model acquisition method and network virtual fitting system

The present disclosure relates to a dedicated ASIC chip system for optical three-dimensional sensing, including a DEPTH ENGINE module, a REGISTER PROCESSOR module, a controller module, a register module, an RGB CMOS driving module, an IR CMOS driving module, an AXI bus interface module, an APB bus interface module, an AXI/APB bridge module, a Flash storage driving module and a DDR3 storage driving module; and when non-optical three-dimensional data is processed, the control module sends an instruction to connect an external Flash memory for processing the non-optical three-dimensional data. When optical three-dimensional data is processed, the control module sends an instruction to simultaneously connect the external Flash memory and an external DDR3 memory for processing the optical three-dimensional data, so as to quickly process high-precision optical three-dimensional data, the resolution of an optical three-dimensional depth image obtained from the processing is high, and the delay is short.

ASIC chip system dedicated for optical three-dimensional sensing

A dynamic phase acquisition device includes a light collecting opening, a semi-reflecting and semi-transmitting mirror, a phase shifter, a polarizer, a plane reflector, a photosensing element and a phase processor. In the dynamic phase acquisition device, light passes through the light collecting opening to the semi-reflecting and semi-transmitting mirror, and then is divided into two channels. One channel of the light sequentially passes through the phase shifter, the polarizer to the photosensing element, to form a first image; the other channel of the light, after being reflected by the plane reflector, directly passes through the polarizer to the photosensing element, to form a second image. The photosensing element sends the first image and the second image to the phase processor, and the phase processor obtains phase data; and a leading or lagging phase shift range of the phase shifter is 1 degree to 20 degrees. By using the phase shifter to provide a lead or a lag of a small amount of degrees, such as from 1 to 20 degrees, or even from 5 to 10 degrees, phase data can be obtained via two-path image detection, thus eliminating the need for optical elements for at least one path detection, and thereby simplifying the structure and reducing costs.

Growing community of inventors

Guangdong, China

Yuanhao Huang