Guangdong Virtual Reality Technology Co., Ltd.

Yongtao Hu

Jingwen Dai

Jie He

Congling Wan

Sibin Huang

Guoxing Yu

Yiqun Wu

An alignment method is provided. A first 3D position and a first IMU calculation 3D position of a position object with an IMU is determined when the IMU enters a steady state. A second 3D position and a second IMU calculation 3D position of the position object is determined when the IMU exits the steady state. A first relative vector is determined based on the first 3D position and the second 3D position. A second relative vector is determined based on the first IMU calculation 3D position and the second IMU calculation 3D position. A rotation matrix is determined based on the first relative vector and the second first relative vector. A coordinate system of the position device is aligned with a coordinate system of the IMU based on the rotation matrix. An electronic device and a non-transitory computer readable storage medium are also provided.

Method and device for aligning coordinate of position device with coordinate of IMU

A method of device tracking is provided. Based on a captured image containing a marker, first spatial position is acquired. Based on a captured image of a scene, second spatial position is acquired. Based on at least one of the first spatial position and the second spatial position, a terminal device may be positioned and tracked.

Method of device tracking, terminal device, and storage medium

A method of controlling virtual content, a terminal device and a computer readable medium are provided. The terminal device includes a display configured to display a virtual object, a camera configured to capture a target image including a marker, at least one processor, and a memory. The memory stores one or more programs configured to be executed by the at least one processor. The one or more programs includes instructions of acquiring the target image including the marker, where a plurality of sub-markers is distributed on the marker; determining a blocked target, wherein the blocked target is a blocked sub-marker of the plurality of sub-markers in the target image; generating a control instruction according to the blocked target; and controlling the displayed virtual object based on the control instruction.

Method of controlling virtual content, terminal device and computer readable medium

An interactive method comprises: obtaining a first spatial position of the first terminal device relative to a marker; determining a first display position of a first virtual object in virtual space according to the first spatial position; receiving interaction data sent from a second terminal device, wherein the interaction data includes model data of a second virtual object and a second spatial position of the second virtual object relative to a marker; determining a second display position of the second virtual object in virtual space according to the first spatial position and the second spatial position; generating the first virtual object according to the first display position, and the second virtual object according to the data of the second virtual object and the second display position; and displaying the first virtual object and the second virtual object.

Interactive method and augmented reality system

A method for identifying light spot, image processing device, and image processing device, and non-transitory computer readable storage medium are disclosed herein. An example method involves: receiving a first image corresponding to a light spot image, wherein the first image is an image of the light spot image displayed in a first color space; converting the first image into a second image, wherein the second image is an image of the light spot image displayed in a second color space; and identifying the light spot with a target color in the second image according to a preset color identifying condition of the second color space.

Method, device and system for identifying light spot

The present disclosure provides a method and device for identifying a light source. The method includes as follows. M stripe sets in an image may be detected. A first energy spectrum data corresponding to each of M stripe sets may be obtained. A second energy spectrum data corresponding to each light source in a database may be obtained. The database may include K light sources, and the energy spectrum data corresponds to an identity of the light source. A correlation coefficient between the second energy spectrum data and the first energy spectrum data may be calculated to obtain M*K correlation coefficients. The identity of each stripe set corresponding to the light source in the database may be determined according to the M*K correlation coefficients. With this disclosure, the tracking of the light source emitted by a controller can be achieved.

Method and device for identifying light source

Method and device for searching stripe set are disclosed herein. The method involves: receiving a raw image captured by a rolling shutter image sensor, wherein the raw image includes stripe pattern formed by flashing light source; binarizing the raw image to obtain a binary image, according to a binary threshold, wherein the binary image has two pixel values, one of the two pixel values is set as a preset first value; searching a connected domain having pixels with a first value to obtain a plurality of first connected domains, according to the pixel value in the binary image; selecting a target connected domain corresponding to the stripe pattern from the plurality of first connected domains; determining stripe set according to the target connected domain, wherein the stripe set is the set of the target connected domain corresponds to the stripe pattern.

Method and device for searching stripe set

The present disclosure provides a method and device for identifying a flashing light source. The method includes as follows. A processor obtains an image captured via a rolling shutter image sensor, the rolling shutter image sensor capturing an image of an environmental background, wherein the environmental background may include movable flashing light sources. A processor obtains stripe sets in the image, wherein the stripe sets can be obtained by capturing the flashing light sources via the rolling shutter image sensor. A processor takes a center of each stripe set as a reference point, and samples along a first direction to obtain n sampling points. A processor identifies the flashing light source by processing the n sampling points. With this disclosure, the identifying automatically of the flashing light source can be achieved.

Method and device for identifying flashing light source

The present application provides a method and device for searching stripe set and a system with the same. Wherein, the method includes: a plurality of first connected domains are obtained in the binary image. A target connected domain is selected from the plurality of first connected domains. The stripe set based on the target connected domain is determined to determine a stripe pattern. A center of the stripe pattern is calculated according to the target connected domain of the stripe set. Whether the stripe set is an effective stripe set is determined based on the center of the stripe pattern. The method can eliminate the impact of incomplete stripe pattern on the image and improve the accuracy of recognition.

Method, device and terminal for determining effectiveness of stripe set

Embodiments of the disclosure provide an image processing apparatus and an image processing method for positioning and identifying signals sources. The image processing apparatus includes an imaging device to capture an image containing a set of pixels, wherein the set of pixels comprises a first subset of pixels representing a plurality of stripes associated with the multiple signal sources; a memory to store the image; a positioning device to determine positions of the multiple signal sources according to the stripes; and an identity determining device to determine identities of the multiple signal sources.

Image processing apparatuses and methods

An electronic tracking device includes an image sensor and a processor is provided. The image sensor is configured for sensing a raw image of an object. The object emits a color visible light and an infrared light. The image sensor includes a color filter array so as to sense the color visible light and the infrared light through the color filter array to acquire the raw image. The color filter array includes at least one color filter channel and an infrared filter channel. The processor is configured for processing the raw image so that the identity and the spatial position of the object are determined in accordance with the raw image. An electronic tracking system and method are also provided. By electronic tracking device, system and method, the accurate identification and tracking of objects can be obtained, thereby generating reliable and timely input to VR systems and/or applications.

Electronic tracking device, electronic tracking system and electronic tracking method

An object identifying and tracking device is provided. The device includes a first image capturer to capture a first raw image of an object, a second image capturer to capture a second raw image of the object, a first processor, a second processor and a post processor. The object includes a first light source emitting light of a first wavelength and a second light source emitting light of a second wavelength. The first processor and the second processor respectively receive the first and the second raw images and respectively extract a first group of information associated with the light of the first wavelength and a second group of information associated with the light of the second wavelength emitted from the object. The post processor processes the first group of information and the second group of information to obtain a third group of information.

Growing community of inventors

Shenzhen, China

Yongtao Hu