초록 ▼

A computer-based system and method of retrieving information pertaining to Web documents on a computer network is disclosed. The method includes maintaining an address map that associates primary addresses with secondary addresses. A primary address includes a network retrieval protocol and a networ

A computer-based system and method of retrieving information pertaining to Web documents on a computer network is disclosed. The method includes maintaining an address map that associates primary addresses with secondary addresses. A primary address includes a network retrieval protocol and a network address. The secondary address may include a different retrieval protocol or a different network address from the primary document address. A Web crawler retrieves a Web document using the primary document address, and determines whether the address map contains a secondary document address prefix corresponding to the primary document address prefix. If a secondary document address prefix exists, the Web crawler creates a secondary address, retrieves additional information pertaining to the Web document, and combines the additional information with the data retrieved from the Web document. The combined data may be stored in an index, and subsequently used to perform a document search.

대표청구항 ▼

[ The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:] [23.] A system for performing a Web crawl, the system comprising:a server computer having a Web crawler program executing thereon;an address map accessible to the Web crawler program an

[ The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:] [23.] A system for performing a Web crawl, the system comprising:a server computer having a Web crawler program executing thereon;an address map accessible to the Web crawler program and containing a plurality of primary Web addresses and a plurality of secondary Web addresses, each primary Web address having a corresponding secondary Web address;the primary Web address including a first protocol for the retrieval of a Web document at the primary Web address;the secondary Web address including a second protocol for the retrieval of a Web document at the secondary Web address;the second protocol for the retrieval of a Web document at the secondary Web address being different than the first protocol for the retrieval of a Web document at the primary Web address;a computer network including at least one Web server having a plurality of Web documents stored thereon, each Web document having a corresponding primary Web address;a database containing information pertaining to the plurality of Web documents;program code for:retrieving a primary Web address corresponding to one of the Web documents;determining whether the primary Web address has a corresponding secondary Web address;selectively retrieving supplementary information pertaining to said one of the Web documents using the corresponding secondary Web address; andif the supplementary information pertaining to said one of the Web documents is retrieved using the secondary Web address, storing said supplementary information in the database.