International Business Machines Corporation

ChaoQiang Zhu

Liang Liu

Wei Zhuang

Junmei Qu

Li Li

Disclosed is a novel system, computer program product, and method to compute an air quality forecast. An air quality forecast model, air quality real-time monitoring data, and air quality forecast data is accessed. A deviation in air pollution emission is monitored by classifying a difference between the air quality monitoring data and the air quality forecast data. This monitoring includes classifying any weather differences which are caused by weather, classifying any terrain differences which are caused by a geographic terrain; and, filtering the difference caused by inaccurate pollution emission inventory. The monitoring may repeat in response to a given time period elapsing or a chance in air quality forecast data received.

Air quality forecast by adapting pollutant emission inventory

A method, system, and computer program product, include determining a task resource consumption predicted for each of one or more tasks being executed on a node, wherein the task resource consumption is a function of time and predicting a node resource consumption of the node based at least on the predicted task resource consumption, wherein the node resource consumption is a function of time.

System, method and computer program product for resource management in a distributed computation system

A computer manages a cache for a MapReduce application based on a distributed file system that includes one or more storage medium by receiving a map request and receiving parameters for processing the map request. The parameters include a total data size to be processed, a size of each data record, and a number of map requests executing simultaneously. The computer determines a cache size for processing the map request, wherein the cache size is determined based on the received parameters for processing the map request and a machine learning model for a map request cache size and reads, based on the determined cache size, data from the one or more storage medium of the distributed file system into the cache. The computer processes the map request and writes an intermediate result data of the map request processing into the cache, based on the determined cache size.

Growing community of inventors

Beijing, China

ChaoQiang Zhu