The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 16, 2022
Filed:
Feb. 12, 2021
Microsoft Technology Licensing, Llc., Redmond, WA (US);
Xu Liu, Sammamish, WA (US);
Steve Chun-Hao Hu, Bellevue, WA (US);
Abhishank Sahu, Renton, WA (US);
Yingji Ju, Bellevue, WA (US);
Gunter Leeb, Redmond, WA (US);
Jose Fernandez, Renton, WA (US);
Swadhin Ajay Thakkar, Bellevue, WA (US);
William Edward Miao, Seattle, WA (US);
Sravanthi Pereddy, Sammamish, WA (US);
Jordan Robert Fitzgibbon, Seattle, WA (US);
Raveena Dayani, Redmond, WA (US);
MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US);
Abstract
Embodiments disclosed herein are related to implementing a near-real-time stream processing system using the same distributed file system as a batch processing system. A data container and partition files are generated according to a partition window that specifies a time range that controls when data is to be included in the partition files. The data container is scanned to determine if the partition files are within a partition lifetime window that specifies a time range that controls how long the partition files are active for processing. For each partition file within the lifetime window, processing tasks are created based on an amount of data included in the partition files. The data in the partition files is accessed and the processing tasks are performed. Information about the partition files is recorded in a configuration data store.