Beijing University of Chemical Tehcnology

Beijing Irtouch Systems Co., Ltd

Weizheng Zhang

Yang Liu

Wei Zhang

Li Wang

Zhiwei Li

Jianjun Liu

Xinlin Ye

Xinbin Liu

Haohan Wu

Qifan Tan

Tianyu Shen

Kunfeng Wang

Weiye Xiao

Tingzhen Zhang

A multimodal perception decision-making method for autonomous driving based on a large language model includes: acquiring an RGB image and an infrared image of a target area at current time; processing the RGB image using a target detection model to obtain a predicted bounding box and a corresponding target detection category; processing the infrared image and the predicted bounding box and the corresponding target detection categories by using a segmentation model to obtain a target mask image; fusing the RGB image, the target mask image and the infrared image using a fusion model to obtain a fused feature map; performing fusion processing on first prompt information representing a user intent, second prompt information representing target detection category priorities, and the fused feature map, using a large Vision-Language Model to obtain textual information; and processing the textual information using a large natural language model to obtain a perception decision-making result.

Multimodal perception decision-making method and apparatus for autonomous driving based on large language model

A control panel and a serial port communication arbiter for a touch screen with a camera are provided. A serial port communication method for a touch screen with a camera includes: transmitting a channel request message to the serial port communication arbiter, the channel request message being used for requesting for occupying the channel between the control panel of the touch screen with camera and an upper computer; receiving a channel response message transmitted by the serial port communication arbiter, the channel response message containing a state of the channel; transmitting data to the upper computer over the channel if the state of the channel is idle. It can save production cost of the control panel, improve system performance, and facilitate maintenance of the control panel.

Control panel and serial port communication arbiter for touch screen with camera

Growing community of inventors

Beijing, China

Weizheng Zhang