Coocon Co., Ltd.

Cheong Seok Back

Jae Won Jeong

A cloud scraping system using pre-scraped big data includes an information providing server which, when receiving a scraping request from a user terminal, provides the user terminal with response information to the received scraping request, and a big data storage which stores pre-scraped information, wherein when the scraping request is about static information, the information providing server acquires the response information using the pre-scraped information. According to the above cloud scraping system using pre-scraped big data, there is an advantage that it is possible to quickly respond to a scraping request from the user terminal afterwards by pre-scraping and storing static information in the big data storage. Additionally, it is possible to improve the scraping server operation efficiency by making a proper use of a single or multi-processing scraping server based on policy information of a scraping target external institution.

Apparatus, method and computer program for cloud scraping using pre-scraped big data

A data scraping system includes: a management module having a service program that calls inquiry or execution requiring scraping to receive user information for scraping and allocate user information and a task using an internal scheduling algorithm; and a scraping module connected to a plurality of different institutions, allowing communication, based on the user information and the task allocated by the management module, to scrape data corresponding to the called inquiry or execution from the plurality of institutions. The scraping module includes a meta database to designate a data item to be scraped, and is configured to extract data to scrape based on the meta database from a data set provided by the institution. According to the data scraping system, it is possible to enable data scraping in various platforms such as mobile computing devices, and collect multiple scraping information in one device without constraints of a security module.

Growing community of inventors

Seoul, South Korea

Cheong Seok Back