关键词: 数据采集, 数据检索, Sphinx, 全文索引

Abstract:

Many academic journal have website on internet,so more people can search papers from it.This paper designs a system for collecting the electronic papers on websites to a database and providing retrieval service.The system has three modules.They are data acquisition,data analysis and storage,data retrieval.The first two modules are responsible for the storage of structured electronic paper on the Internet to the local database,The last one is responsible for the generation of database index and providing retrieval service.There have 1.5 million electronic papers in this system.

Key words: data acquisition;data retrieval;Sphinx;full-text index