International Business Machines Corporation

Ju Wei Shi

Chen Wang

Jia Zou

Li Li

Lan Jun Wang

Qi Yu

Kun Wang

Zhao Cao

Guan Cheng Chen

Yu Ying Wang

Heng Cao

Ben Bo Yang

Liang Liu

Shuo Zhang

Wen Jie Wang

Yi Ge

Chi Liu

Li Mei Jiao

Yu Wang

Chao Zhang

Wei Shan Dong

Chun Ma

Wei Xue

Paul Sherwood Taylor

Xiao Yang

Chunhua Tian

James Allen Reimer

Yun Jie Qiu

Lanjun Wang

Liu Tao

Jia Jia Wen

Bo Yang

Peng Li

Lin Xu

Yong Sen Zheng

Yi Zhao

Jie Liu

Bing Jiang Sun

Jun Ma

Rui Xiong Tian

Wenjie Wang

Guotao Zhao

Chang Hai Yan

Xiao Ning Zhang

Technical solutions are described to implement a scalable write ahead log using a distributed file system. A general aspect includes a method for providing consistency among metadata replicas and content in an enterprise content management cluster. The method includes recording a transaction log entry in response to receiving a content modification request, the transaction log entry including a version identifier set to a first version value. The method also includes updating the transaction log entry to a second version value in response to successfully modifying content and one of a plurality of metadata replicas containing metadata corresponding to the request. The method also includes updating the transaction log entry to a third version value in response to successfully modifying each of the metadata replicas. The present document further describes examples of other aspects such as methods, computer products.

Scalable enterprise content management

Methods and a system are provided. A method includes automatically detecting, by an attribute structural variation detector, attribute structural variations in record schemas of a database lacking schema enforcement. The automatically detecting step includes encoding, by an encoder, nodes in the record schemas based on respective updated node labels to obtain a plurality of codes. The encoding step comprises, for each of the plurality of codes: recording, by a label frequency counter, a frequency fof the record schemas that include a given label; and recording, by a label frequency counter, a frequency fof the record schemas that use a given one of the plurality of codes to update a label of a next level. An attribute variation is detected and retrieved responsive to the frequency f&#x2260;0, and the frequency f&#x3e;(two times the frequency f).

Automatic attribute structural variation detection for not only structured query language database

Method and apparatus for configuring relevant parameters of MapReduce applications. The method includes: receiving a request for processing a first MapReduce job; obtaining job feature attributes of historical MapReduce jobs; searching out a job feature attribute of a second MapReduce job associated with the first MapReduce job from within the job feature attributes of the historical MapReduce jobs; configuring relevant parameters of the first MapReduce job based on the job feature attribute of the second MapReduce job. According to this method of configuring parameters, network overheads of file transfer can be effectively reduced, the method of configuring parameters of the MapReduce job can be processed locally as much as possible, thereby effectively increasing system resource utilization while reducing the administrator's configuration burden. An apparatus for configuring relevant parameters of MapReduce application is also provided.

Method and apparatus for configuring relevant parameters of MapReduce applications

A method and system for generating a job alert. According to embodiments of the present invention, before a target job is processed, a characteristic of input and output of the target job in at least one stage is determined through analyzing a historical job, and a resource overhead associated with the processing of the target job is calculated based on the characteristic of input and output. Then, an alert for the target job is generated in response to the resource overhead exceeding a predetermined threshold. In such manner, an alert for the target job can be proactively generated before the resource overhead problem occurs, so as to enable an administrator or developer to discover a fault in advance and adopt measures actively to avoid loss and damage to the intermediate results or output data when the target job is processed.

Generating job alert

Garbage collection in a first node server of an in-memory replication system includes: in response to a garbage collection trigger in the first node server, determining whether identification information for a data object eligible for garbage collection in the first node server has been received by the first node server from at least a second node server in the in-memory replication system; and if the identification information has been received from at least the second node server, performing garbage collection on the data object with the first node server.

Garbage collection in an in-memory replication system

A system, method and computer program product configured for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.

Method and apparatus for processing database data in distributed database system

A method and an apparatus for determining a location of a mobile device. The location of a mobile device is determined accurately according to information which includes call data records of the mobile device. By employing a partial ellipse integral model, two physical world factors are taken into consideration in reducing the location uncertainty in call data records. The factors include: spatiotemporal constraints of the device's movement in the physical world and the telecommunication cell area's geometry information, which increase the accuracy of determining the location of a mobile device.

Determining a location of a mobile device

Methods and a system are provided. A method includes automatically detecting, by an attribute structural variation detector, attribute structural variations in record schemas of a database lacking schema enforcement. The automatically detecting step includes encoding, by an encoder, nodes in the record schemas based on respective updated node labels to obtain a plurality of codes. The automatically detecting step further includes clustering, by a clusterer, the plurality of codes into one of a used category and an unused category. The used category and the unused category respectively consist of any of the plurality of codes used or unused to update a child label. The automatically detecting step also includes, when an intersection set formed from the used and unused categories has at least one member, retrieving, by the attribute structural variation detector, the at least one member as a structural variation between at least two of the record schemas.

Embodiments include methods and devices for identifying record schemas in a non-relational database by assigning a record to a schema bucket according to structural characteristics of the record and identifying a record schema of the record within the schema bucket so that records with isomorphic record schemas in the non-relational database can be determined. Aspects also include encoding keys of a lowest level of a record according to a global codemap, sorting the keys of the lowest level that belong to different parent keys respectively and updating key names of corresponding parent keys in the parent level of a children level according to the codes of the keys of the children level.

Record schemas identification in non-relational database

A mechanism is provided for identifying a usage for data in a data structure. A set of configuration files associated with a set of services are analyzed to identify at least one class associate with the data in the data structure thereby forming a data structure-to-class mapping. Source code associated with the set of services is analyzed to identify a set of services used by at least one class in the data structure-to-class mapping thereby forming a service-to-class mapping. A set of specification files associated with the set of services are analyzed to identify a set of uses associated with at least one service in the service-to-class mapping thereby forming a use-to-service mapping. An identification of usage information of the data structure is generated using the data structure-to-class mapping, the service-to-class mapping, and the use-to-service mapping.

Discovery of application information for structured data

A computer program product configured to implement a method for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.

A computer processing method includes receiving network data; filtering a node with a degree higher than a predefined threshold in the network data; storing the filtered node and its neighborhood relationship; clustering the filtered network data to obtain primary group(s); and obtaining a final group based on the filtered node and its neighborhood relationship and the primary group(s). The computer processing method and a corresponding system can be applicable to the processing for network data of large scale, and reduce greatly the processing time for clustering the network data of large scale, and the invention can be implemented well in parallel.

Computer processing method and system for network data

The present invention provides a method and apparatus of controlling subscription requests, which can be used in a publish/subscribe engine. The method includes parsing a received subscription request into a predicate expression; determining an occurrence probability of the subscription request based on occurrence probabilities of predicates in the predicate expression; estimating a message increment to be caused by the subscription request based on a message publishing rate associated with the subscription request and on the occurrence probability of the subscription request; and controlling a quality of service of messages based on the estimated message increment.

Control method and apparatus for publish/subscribe systems

Growing community of inventors

Beijing, China

Ju Wei Shi