Peking University

Beijing Founder Electronics Co., Ltd.

Jianwu Yang

Xinli Wu

Xiaoming Yu

Dan Zhang

Xiao Bi Liang

Song Wang

Yan Zheng

Lei Yan

Rufeng Liang

Liyong Zhao

Hong'e Sun

A method and system of discovering and analyzing structures of user groups in a microblog is provided in this invention. The method of discovering and analyzing structures of the user groups in a microblog comprises: acquiring information on behavior data of microblog users of a target group; constructing a microblog user association network based on the information on behavior data of the microblog users of the target group; acquiring at least one maximal clique from the microblog user association network; acquiring at least one core clique based on the maximal clique; and conducting behavior analysis on the user groups in the microblog based on the acquired maximal clique and/or the acquired core clique. Using the method and system of discovering and analyzing structures of user groups in a microblog provided in this invention, complicated relationships among microblog users may be sufficiently identified and the speed of discovering and analyzing structures of user groups in a microblog may be improved to meet the demand for large scaled data processing.

Method and system of discovering and analyzing structures of user groups in microblog

The present application discloses methods and systems for incrementally collecting replies in a forum and belongs to the technical field of collecting network information. The method comprises periodically determining whether there is a newly-established post and a post having new replies in all forum list pages needed to be collected: if yes, extracting a main post and reply information from the newly-established post, and extracting the information of the new replies from the post having new replies. The system comprises a determining device () for periodically determining whether there is a newly-established post and a post having new replies in all forum list pages needed to be collected; and an extracting device () for extracting a main post and reply information from the newly-established post, and extracting the information of the new replies from the post having new replies. The present application can quickly, accurately and completely collect all main post/replies of a post, so that the drawback that the information of turned pages of a post are missed to be searched or cannot be searched through a general search engine may be overcome.

Method and system for incremental collection of forum replies

The invention discloses a method of collecting network data. This method is applicable to collection of data of network documents, published on a website, related respectively to M subjects, wherein M is a positive integer, the method including: configuring webpage link addresses, of network data to be collected, into queues of corresponding types according to types corresponding to the webpage link addresses of the network data to be collected, wherein the webpage link addresses of the network data to be collected are link addresses of webpages where the data of the network documents related respectively to the M subjects are located; obtaining webpage source codes corresponding to the webpage link addresses, of the network data to be collected, in the queues of the corresponding types; and extracting the data of the network documents corresponding to URLs corresponding to the webpage source codes according to the URL information and collection depth values of the URLs.

Method of and system for collecting network data

The present application provides web information detecting method and system. The method according to the present application comprises: pre-extracting keywords from a web page; storing a corresponding relationship between the extracted keywords and a URL of the web page in a database; obtaining a source file of a web page to be detected; searching the database for keywords that have the same URL as that of the web page to be detected; comparing the searched keywords to the source file information of the web page to be detected; and determining the existence of information of the web page to be detected according to a matching degree. The present application increases the accuracy of web information detection.

Webpage information detection method and system

A distributed system for downloading distributed Internet information and a method thereof are disclosed. A distribution subsystem receives downloading task information from a user, and sends the downloading task information to a downloading subsystem. The downloading subsystem downloads task result information according to the downloading task information, and sends the task result information to the distribution subsystem. The distribution subsystem receives the task result information, and returns the task result information to the user made the request. The physical environment of the system can include a distribution server and a downloading subsystem group, the internal function of the system is to assign the required tasks to the downloading subsystem group based on a queue model, the downloading subsystem group can process the assigned tasks concurrently. The system and the method is adapt to a mass-data acquisition over Internet, which may significantly improve the efficiency and timeliness for obtaining information.

Distributed system for downloading internet information and a method thereof

The present disclosure provides a method and apparatus for acquiring a content information of a page, by acquiring an access link primary address and an access link secondary address of a website, and then determining a layout page corresponding to the website through the access link primary address and the access link secondary address, and extracting summary information of each post included in the layout page from a source code file of the layout page; and acquiring a link address of each post from the summary information, determining a post page of each post according to the link address, and extracting content information of each post from a source code file of the post page, the method disclosed in the present disclosure could acquire latest initiating post and replying post information published on the bulletin board system website can in real time, and acquire replying posts incrementally.

Growing community of inventors

Beijing, China

Jianwu Yang