International Business Machines Corporation

Srinivasan Balasubramanian

Ramani Ranjan Routray

Andrew Stephen Tomkins

Kaladhar Voruganti

Akshat Verma

Rohit Jain

Michael Ching

Gauri Sudhir Shah

Roberto C Pineiro

Piyoosh Jalan

Satish Chandra Penmetsa

Tushar Mohan

Runping Qi

Laurent Chavet

A system and method of crawling at least one website comprising at least one URL includes maintaining a lookup structure comprising all of the URLs known to be on a website; calculating a hub score for each webpage of the website to be recrawled, wherein the hub score measures how likely the to be recrawled webpage includes links to fresh content published on the website; sorting all the to be recrawled pages by their hub scores; and crawling the to be recrawled pages in order from highest hub scores to lowest hub scores. The calculating comprises computing a first value equaling a percentage of a number of new relative URLs on the to be recrawled page; computing a second value equaling a percentage of a previous hub score of the to be recrawled page; and computing the hub score as a sum of the first and the second values.

Microhubs and its applications

Formulating an integrated disaster recovery (DR) plan based upon a plurality of DR requirements for an application by receiving a first set of inputs identifying one or more entity types for which the plan is to be formulated, such as an enterprise, one or more sites of the enterprise, the application, or a particular data type for the application. At least one data container representing a subset of data for an application is identified. A second set of inputs is received identifying at least one disaster type for which the plan is to be formulated. A third set of inputs is received identifying a DR requirement for the application as a category of DR Quality of Service (QoS) class to be applied to the disaster type. A composition model is generated specifying one or more respective DR QoS parameters as a function of a corresponding set of one or more QoS parameters representative of a replication technology solution. The replication technology solution encompasses a plurality of storage stack levels. A solution template library is generated for mapping the application to each of a plurality of candidate replication technology solutions. The template library is used to select a DR plan in the form of a replication technology solution for the application.

Methods, systems, and computer program products for disaster recovery planning

Disclosed is a method of retrieving constant values. The method comprises compiling key-value pairs into a unified regular expression, evaluating the unified regular expression against a transformed input string to match a particular key and extracting the constant value associated with that particular key. The input string in transformed by linking different tags associated with each key-value pair in the unified regular expression into a single linked tag and linking the single linked tag to the input string. Additionally, the method provides for associating the constant value in each key-value pair with an un-fixed key (i.e., a unique regular expression) as opposed to a fixed key, so that different input strings can be matched to the same key.

Method for retrieving constant values using regular expressions

A collaborative focused crawler crawls documents on a network locating documents that match multiple focus topics. The collaborative crawler comprises a fetcher and a focus engine. The fetcher prioritizes which documents to crawl based on a set of rules, obtains documents from the network, and outputs crawled documents to the focus engine. The focus engine determines whether a fetched document is relevant to any of the multiple focus topics. The focus engine determines whether fetched documents are disallowed. If a fetched document is disallowed, the present system may place the URL for that web document in a blacklist, a list of URLs that may not be crawled. URLs may be disallowed if they match a disallowed topic or if they fail a set of rules designed for a web space focus, for example, domain rules, IP address rules, and prefix rules.

System, method, and service for collaborative focused crawling of documents on a network

Growing community of inventors

San Jose, CA, United States of America

Srinivasan Balasubramanian