The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 26, 2025
Filed:
Jun. 10, 2022
Baidu Usa Llc, Sunnyvale, CA (US);
Baidu.com Times Technology (Beijing) Co., Ltd., Beijing, CN;
Haofeng Kou, Sunnyvale, CA (US);
Davy Huang, Sunnyvale, CA (US);
Manjiang Zhang, Sunnyvale, CA (US);
Xing Li, Sunnyvale, CA (US);
Lei Wang, Beijing, CN;
Huimeng Zheng, Beijing, CN;
Zhen Chen, Beijing, CN;
Ruichang Cheng, Beijing, CN;
BAIDU USA LLC, Sunnyvale, CA (US);
BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD., Ca Beijing, CN;
Abstract
A system obtains a performance profile corresponding to times taken to perform an inferencing by a machine learning (ML) model using a different number of processing resources from a plurality of processing resources. The system determines one or more groupings of processing resources from the plurality of processing resources, each grouping includes one or more partitions. The system calculates performance speeds corresponding to each grouping based on the performance profile. The system determines a grouping having a best performance speed from the calculated performance speeds. The system partitions the processing resources based on the determined grouping to perform the inferencing.