International Business Machines Corporation

Peter Andrew Nicholls

Jason Allan Nikolai

Alexander Cook

James E Cancilla

Samantha Chan

Mary M L Komor

John Matthew Santosuosso

Ryan Kirk Cradick

David M Koster

Cory J Kleinheksel

Gary Mazo

Victor Dogaru

Brent Cecil Hawks

Ira L Sheftman

Gordon Raymond Chiu

Sean James Martin

Christina P Lau

David Kenneth McKnight

Steven Cooper

Moshe Morris Emanuel Matsa

Jeremiah S Swan

Roger Harry Pett

Ilene Ruth Seelemann

Ella Belisario

Laura Lee Girolami-Rose

Ronald So-tse Woan

Erin Harris

Henry Zongaro

Sean P Kennedy

David A Salinas

Jonathan E P Tzanakakis

Edmund Johnson

Song Wu

Ankit Pasricha

Jungkyoo Pamela Ham

Andrea K Rice

James Pangborn Wells

Jeremiah Stephen Swan

Roger Harry Edwin Pett

A method, computer program product, and computing device for monitoring network activity associated with streaming a data load through a stream application including a plurality of stream operators deployed on a plurality of computing devices. One or more stream operators with one or more external connections may be identified from the plurality of stream operators. The identified one or more stream operators may be deployed based upon, at least in part, the one or more external connections.

System and method for identifying external connections in a streaming application

A method for debugging a streaming application is provided. The method may include establishing, by a processor, a debug region in the streaming application to mark a subgraph for debugging. The method may further include receiving a tuple flow suspension notification from a job control plane. The method may also include displaying a plurality of debugging options for debugging a streaming application on a graphical user interface based on the received tuple flow suspension notification. The method may further include determining a debugging option from the displayed plurality of debugging options based on a user selection on the graphical user interface. The method may also include translating the determined debugging option into a format compatible with the job control plane. The method may further include transmitting the translated debugging option to the job control plane.

Debugging streaming applications using debug regions

Methods and apparatus, including computer program products, implementing and using techniques for data stream processing in a runtime data processing environment. A stream processing graph that includes several connected operators is received. Source code of the operators is analyzed to identify hints describing whether an operator contains data structures, method parameters or other data that can be applied in a parallelization data processing environment. Performance metrics of the data processing environment within parallel regions is evaluated to determine whether data processing resources can be dynamically scaled up or down. In response to determining that the data processing resources can be dynamically scaled up, one or more operators are split to be processed on two or more parallel processing resources. In response to determining that the data processing resources can be dynamically scaled down, one or more operators are combined to be processed on a single parallel processing resource.

Dynamic stream operator fission and fusion with platform management hints

Methods for data stream processing in a runtime data processing environment. A stream processing graph that includes several connected operators is received. Source code of the operators is analyzed to identify hints describing whether an operator contains data structures, method parameters or other data that can be applied in a parallelization data processing environment. Performance metrics of the data processing environment within parallel regions is evaluated to determine whether data processing resources can be dynamically scaled up or down. In response to determining that the data processing resources can be dynamically scaled up, one or more operators are split to be processed on two or more parallel processing resources. In response to determining that the data processing resources can be dynamically scaled down, one or more operators are combined to be processed on a single parallel processing resource.

A stream of tuples may be processed by receiving at a first stream operator a first tuple from a stream of tuples. In response to receiving the first tuple, port mutability conditions for a first stream operator and a second stream operator may be analyzed. In response to identifying the port mutability conditions for a first stream operator and a second stream operator, a first set of attribute mutability conditions for the first tuple received at the first stream operator may be identified. Based on the first set of attribute mutability conditions, a reference of an attribute from the first tuple may be generated where the reference is added to a second tuple passing from the first stream operator to the second stream operator.

Processing a stream of tuples

Embodiments of the present invention address deficiencies of the art in respect to parsing for source code porting and provide a novel and non-obvious method, system and computer program product for a user-extensible rule-based source code modification tool. According to an aspect of the present invention, an automated parsing tool for parsing and modifying source code is provided which supports the addition of user-defined rules, and which parses and either modifies source code or suggests modifications to source code based upon the user-defined rules. Users can also associate a user-defined or predefined modification with each rule so that upon detection of a condition satisfying the rule, the user can be presented with the modification as an option. Compound rules built by using one or more rules as preconditions to a rule are also supported.

User-extensible rule-based source code modification

An illustrative embodiment of a computer-implemented process for scalable group synthesis receives a group definition, applies a sub-set of conditions to the group definition to form a conditioned group definition, receives a set of entities and populates group membership using the received set of entities and the conditioned group definition, wherein each member responds in the affirmative to the sub-set of conditions.

Scalable group synthesis

The present invention provides a visual debugger for dynamic XLS transformations. A method for real time debugging of mixed Java and Extensible Stylesheet Language Transform (XSLT) code comprises sending debug events from Java and XSLT debug sub-adapters to a debug super adapter, filtering the debug events received from the Java and XSLT debug sub-adapters, generating debug events representing a consolidated view of the received debug events, and sending the debug events to a debug user interface (UI).

Visual debugger for dynamic XSL transformations

A method of creating and maintaining debug points in an integrated development environment (IDE) includes receiving a first query at a computing device coupled to the IDE, the first query identifying one or more actions; searching the source code with the computing device to locate locations where the one or more actions occur; forming an initial result set that includes locations of the one or more actions; receiving a desired behavior action for some or all of the locations; associating the initial result set and the desired behavior actions to form a first mapping; and storing the mapping and the first query as a first dynamic query based debug point map.

Dynamic query-based debug point mapper

A data structure embodied in a computer-readable storage medium for configuring connections from a local workstation between a file system residing on the local workstation and a file system residing on a remote host system. The data structure provides for such configuration by allowing the user to specify the host system, specify a host directory path within the host file system, and specify a mapping between a file within the host directory path on the host file system and a file on the local file system. After such configuration, the user may access the host file system file in the same manner as a local file system file. The data structure can encode information describing a file system connection between a local system and a host system in a metalanguage format comprising one or more tags, each tag having an identifier and a set of one or more attributes, wherein the encoded information comprises a file system connection descriptor which can be parsed according to the metalanguage tags.

Method of, system for, and computer program product for providing a data structure for configuring connections between a local workstation file system and a remote host file system

An attribute presenter of object attributes from at least one object includes an attribute controller for determining which attributes to select; an attribute collector for collecting and normalizing the determined attributes from the at least one object; an attribute organizer for organizing the collected and normalized attributes for display; and an attribute viewer for displaying the organized object attributes. A method for presenting object attributes using an attribute presenter includes the steps of determining which object attributes to select using an attribute controller; collecting and normalizing the determined object attributes from at least one object using an attribute collector; organizing the collected and normalized object attributes for display by an attribute organizer; and displaying the organized object attributes by an attribute viewer.

Attribute presenter of object attributes and method for presenting object attributes using the attribute presenter

Growing community of inventors

Janetville, Canada

Peter Andrew Nicholls