Microsoft Technology Licensing, LLC

Abhishek Uday Kumar Shah

Mark A Kromer

Anudeep Sharma

Jikai Ma

Wee Hyong Tok

Sean Gormley T Kelley

Yanjie He

Andrea Treviño Gavito

A method for recommending a computer hardware configuration, including: receiving, by a processor, a machine-readable specification of a computing task; extracting, by the processor, a plurality of features from the machine-readable specification of the computing task; supplying, by the processor, the plurality of features to a reinforcement learning model to generate a proposed computer hardware configuration to execute the computing task; and providing, by the processor, the proposed computer hardware configuration to a user.

Automatic selection of computer hardware configuration for data processing pipelines

Methods, systems and computer program products are provided for automated runtime configuration for dataflows to automatically select or adapt a runtime environment or resources to a dataflow plan prior to execution. Metadata generated for dataflows indicates dataflow information, such as numbers and types of sources, sinks and operations, and the amount of data being consumed, processed and written. Weighted dataflow plans are created from unweighted dataflow plans based on metadata. Weights that indicate operation complexity or resource consumption are generated for data operations. A runtime environment or resources to execute a dataflow plan is/are selected based on the weighted dataflow and/or a maximum flow. Preferences may be provided to influence weighting and runtime selections.

Automated runtime configuration for dataflows

Growing community of inventors

Seattle, WA, United States of America

Abhishek Uday Kumar Shah