Fuji Xerox Co., Ltd.

Shang Ma

Qiong Liu

Sven Kratz

Patrick Chiu

Donald G Kimber

Hao Tang

Systems and methods for automated vehicle guidance based on coded lighting to enable automated vehicle following and/or regrouping. Systems use projectors to project temporal identifiers for space partitioned by pixel projections. Different space partition is associated with a different identifier. By using simple light sensors mounted on the vehicles, and decoding the sensed light signal, the vehicle can determine its precise location in the space relative to the coded light projector. This information may be used for precise vehicle guidance to enable vehicle following and/or regrouping. For vehicle following, the coded light projector is placed on a moving vehicle. For vehicle regrouping, the coded light projector may be placed on a ground or on a pole. Depending on the guidance precision requirements, the coded light precision may be adjusted by using light projectors with different resolutions.

Systems and methods for automated vehicle following and regrouping

A computer-implemented system and method for using certain simulated sensors constructed with an accurate localization sensor and a mobile phone to replace/enhance many existing real-life sensors. By using 'simulated sensor' to convert localization sensor measurement to real signal outputs that are similar to real distance-sensor outputs, real direction sensor outputs, or real line following sensor outputs, one or more embodiments of the invention may be used to upgrade traditional robots by plugging these simulated outputs to robots' corresponding sensor inputs without the need to rewire or add customized hardware.

Systems and methods for using an external sensor and a mobile device to simulate real sensors for a robot

Described is a way to steer speaker array or microphone array based on direction outputs of tiny light sensors attached to TV viewers, noisy-environment workers, or AR/VR system users. More specifically, a light projector is disposed on a ceiling, which sends out different sequential on/off signals for each pixel. Two light sensors are attached to each speaker array or microphone array, and one or more light sensors are attached to each user. Because each projector pixel corresponds to a specific direction, when a light sensor receives sequential signal from the projector, the light sensor can determine its direction corresponding to the projector and report that to the central station. With the speaker/microphone array direction and user direction known, the system can generate proper phase shifts for different speaker signals and generate directional sound for each individual. Similarly, the central station can determine phase shifts for combining audios from different microphones.

Systems and methods for steering speaker array and microphone array with encoded light rays

An indoor localization and navigation system for a mobile robot, the system comprising: a projector mounted on the mobile robot and configured to project a temporal projector light signal, wherein the temporal projector light signal is encoded, for each pixel of the projector, with an information segment comprising the pixel coordinates of the each pixel of the projector; a stationary sensor node comprising a light sensor configured to detect the temporal projector light signal and generate a sensor signal and a transmitter configured to transmit a sensor node identifier and a position code generated based on the sensor signal; a receiver mounted on the mobile robot and configured to receive the sensor node identifier and the position code from the transmitter; and an onboard computer mounted on the mobile robot and operatively coupled to the projector and the receiver, wherein the onboard computer is configured to receive the sensor node identifier and the position code from the receiver and to determine a location information of the mobile robot based on the received sensor node identifier and the position code.

Mobile robot indoor localization and navigation system and method

Precision docking is one of the most important tasks for drones and surface robots to charge themselves and load/unload packages. Without accurate docking, surface robots and drones will miss their charging pad or charging contacts and cannot automatically charge themselves for later tasks. Described is a system using coded light to guide the precision docking process for drones and ground robots. More specifically, the system uses projectors to project temporal identifiers for space partitioned by pixel projections. Different space partition gets a different identifier. By using a simple light sensor on a drone or a ground robot, the drone or the ground robot can know its precise location in the space and therefore knows where to move for a precise docking. Depending on docking precision requirement, the coded light precision may be adjusted by using projectors with different resolutions.

Systems and methods employing coded light to dock aerial drones, self-driving cars and surface robots

Computerized systems and computer-implemented methods that enable printing on a large solid surface, such as a floor, wall, or ceiling using mobile printer heads guided by coded light. In one implementation, a user points a projector onto the printing surface to project a sequence of images with a unique temporal identifier (ID) for each pixel, wherein different space partitions are associated with different pixel IDs. The mechanical transmissions of the conventional printers are replaced with the aforesaid coded light used in conjunction with small mobile printer heads equipped with light sensors, while the coded light is used to guide the printer heads' movements during the printing process.

Systems and methods for printing on large surface with portable printing devices

Finger-tracking systems and methods for virtual instruments playback. The described system tracks the position of user's ten fingers on a projection surface and can be used to play virtual instruments such as virtual piano, drums, and bells. The system tracks the movement of user's ten fingers while keeping them free of encumbrance or excessive postural constraints. More specifically, in one or more embodiments, a coded light based projector is used to send out location signal onto a flat surface, and ten light sensors are mounted on user's fingers to receive these signals and locate user's fingers. Based on their locations and relative distance to a fixed point, a printed music instrument can be used for virtual instrument music playback. With the described tracking system, various embodiments of virtual music instruments may be implemented, including a system and method for virtual piano playing as well as virtual Chinese bell playing on printed keyboard and printed Chinese bell set.

Systems and methods for playing virtual music instrument through tracking of fingers with coded light

A system and method for generating a projected image signal encoded with position information. The temporal pixel-location data is hidden within visible light signal used for regular image projection. This enables the user to utilize one or multiple ring-shaped light receivers to implement touch or multi-touch functions on a regular image content generated using light from the same projector. The temporal light signal generated by the projector is sliced into multiple temporal segments. The segments include segments of two different types. A segment of the first type is used for carrying a temporal position signal of each pixel in the projector signal. On the other hand, a segment of the second type is used to adjust the color of each pixel. With the color adjustment segment projected to each image pixel, a meaningful visible content of a regular image can be displayed despite the presence of the position-encoded signal segments.

Growing community of inventors

Irvine, CA, United States of America

Shang Ma