Peking University

Beijing Founder Electronics Co., Ltd.

Xinli Wu

Jianwu Yang

Dan Zhang

Song Wang

Rufeng Liang

Hong'e Sun

The present application discloses methods and systems for incrementally collecting replies in a forum and belongs to the technical field of collecting network information. The method comprises periodically determining whether there is a newly-established post and a post having new replies in all forum list pages needed to be collected: if yes, extracting a main post and reply information from the newly-established post, and extracting the information of the new replies from the post having new replies. The system comprises a determining device () for periodically determining whether there is a newly-established post and a post having new replies in all forum list pages needed to be collected; and an extracting device () for extracting a main post and reply information from the newly-established post, and extracting the information of the new replies from the post having new replies. The present application can quickly, accurately and completely collect all main post/replies of a post, so that the drawback that the information of turned pages of a post are missed to be searched or cannot be searched through a general search engine may be overcome.

Method and system for incremental collection of forum replies

The invention discloses a method of collecting network data. This method is applicable to collection of data of network documents, published on a website, related respectively to M subjects, wherein M is a positive integer, the method including: configuring webpage link addresses, of network data to be collected, into queues of corresponding types according to types corresponding to the webpage link addresses of the network data to be collected, wherein the webpage link addresses of the network data to be collected are link addresses of webpages where the data of the network documents related respectively to the M subjects are located; obtaining webpage source codes corresponding to the webpage link addresses, of the network data to be collected, in the queues of the corresponding types; and extracting the data of the network documents corresponding to URLs corresponding to the webpage source codes according to the URL information and collection depth values of the URLs.

Method of and system for collecting network data

The present application provides web information detecting method and system. The method according to the present application comprises: pre-extracting keywords from a web page; storing a corresponding relationship between the extracted keywords and a URL of the web page in a database; obtaining a source file of a web page to be detected; searching the database for keywords that have the same URL as that of the web page to be detected; comparing the searched keywords to the source file information of the web page to be detected; and determining the existence of information of the web page to be detected according to a matching degree. The present application increases the accuracy of web information detection.

Webpage information detection method and system

The present disclosure provides a method and apparatus for acquiring a content information of a page, by acquiring an access link primary address and an access link secondary address of a website, and then determining a layout page corresponding to the website through the access link primary address and the access link secondary address, and extracting summary information of each post included in the layout page from a source code file of the layout page; and acquiring a link address of each post from the summary information, determining a post page of each post according to the link address, and extracting content information of each post from a source code file of the post page, the method disclosed in the present disclosure could acquire latest initiating post and replying post information published on the bulletin board system website can in real time, and acquire replying posts incrementally.

Growing community of inventors

Beijing, China

Xinli Wu