Automatic Incorporation of Search engines into a
Large-Scale Metasearch Engine
Ref: Z. Wu, V. Raghavan, H. Qian, V. Rama K, W. Meng, H. He, C. Yu. Towards Automatic Incorporation of Search Engines into a Large-Scale Metasearch Engine. 2003 IEEE/WIC International Conference on Web Intelligence, Halifax, Canada, October 2003
A metasearch engine supports unified access to multiple component search engines. To build a very large-scale metasearch engine that can access up to hundreds of thousands of component search engines, one major challenge is to incorporate large numbers of autonomous search engines in a highly effective manner. To solve this problem, we propose automatic search engine discovery, automatic search engine connection, and automatic search engine result extraction techniques. Experiments indicate that these techniques are highly effective and efficient.
Introduction
In the context of a metasearch engine, the process of inco....