Baidu USA LLC

Baidu.com Times Technology (beijing) Co. Ltd.

Huimeng Zheng

Lei Wang

Manjiang Zhang

Zhen Chen

Davy Huang

Xing Li

Haofeng Kou

Ruichang Cheng

A system obtains a performance profile corresponding to times taken to perform an inferencing by a machine learning (ML) model using a different number of processing resources from a plurality of processing resources. The system determines one or more groupings of processing resources from the plurality of processing resources, each grouping includes one or more partitions. The system calculates performance speeds corresponding to each grouping based on the performance profile. The system determines a grouping having a best performance speed from the calculated performance speeds. The system partitions the processing resources based on the determined grouping to perform the inferencing.

System on chip parallel computing of ML services and applications for partitioning resources based on the inference times

Growing community of inventors

Beijing, China

Huimeng Zheng