초록

A system and a method providing for the distribution and management of a large corpus of value added electronic documents while providing customized services to a plurality of diverse end users.

대표청구항 ▼

The invention claimed is: 1. A system for maintaining a large aggregation of electronically stored documents and making them available to users that submit inquiry messages, comprising: a. at least one data collection for storing documents in electronic form, each document having a unique identifie

The invention claimed is: 1. A system for maintaining a large aggregation of electronically stored documents and making them available to users that submit inquiry messages, comprising: a. at least one data collection for storing documents in electronic form, each document having a unique identifier; b. an intake component for receiving the content of new documents to be added to the at least one data collection; c. an enrichment component associated with the intake component for processing a received document to enrich the document before storing it as available in the at least one data collection; d. a plurality of resource application components for vending information, each having a user interface component for receiving at least one user inquiry message seeking information from the data collection; e. a search component for processing the at least one user inquiry message to identify documents in the data collection that are responsive and retrieving an identifier for documents that are responsive; and f. a delivery component responsive to a user document request and to the resource application component that receives a user inquiry message for delivering a requested document with forms of enrichment as determined by such resource application component. 2. The system of claim 1 wherein the system further comprises a persistence service for storing retrieved identifiers for later access without the search component reprocessing the at least one user inquiry message. 3. The system of claim 1 wherein the system further comprises a table of contents service for maintaining at least one table of contents with a plurality of nodes, one or more of said nodes identifying one or more documents associated with said one or more nodes. 4. The system of claim 3 wherein the table of contents service supports two or more tables of contents, each table of contents being adapted to a particular user type. 5. The system of claim 3 wherein the at least one table of contents references documents that are in two or more data collections. 6. The system of claim 4 wherein one of the two or more tables of contents references a node in another of the two or more tables of contents to define a recursive structure. 7. The system of claim 1 wherein documents in the at least one data collection are partitioned into at least one collection subset and the system has an index service that maintains an index of keywords appearing at least once in the collection subset, with an association between the keywords in the index and the location of their appearance in the collection subset. 8. The system of claim 1 wherein documents in the at least one data collection are partitioned into at least one collection subset and wherein an intake component for receiving new documents ensures that each additional document has a unique identifier and is assigned to at least one collection subset. 9. The system of claim 1 wherein the at least one data collection has a least one document set that is an aggregation of the documents in one or more collection subsets. 10. The system of claim 1 wherein the system further comprises a security service component that receives user identification information and inquiry messages and validates the identification information and inquiry messages against user subscription information. 11. The system of claim 1 wherein the enrichment component processes a document to cause association of the document with at least one of the following: a. additional editorial material prepared by a human agent; b. additional editorial material prepared by an automated agent; c. a link providing a pointer to another document in the data collection; d. citation based metadata to legal or bibliographic documents; or e. an entry associated with the document appearing in a metadata file. 12. The system of claim 1 wherein the intake component for receiving new documents prioritizes the received documents and processes out of a normal order based on time of receipt documents bearing a time sensitive indicator. 13. The system of claim 1 wherein the intake component for receiving new documents checks the uniqueness of an assigned document identifier before a new document with such document identifier is made available in the at least one data collection. 14. The system of claim 1, wherein the intake component for receiving new documents checks a new document for a predetermined intake format before such new document is made available in the at least one data collection. 15. The system of claim 1 wherein the aggregation of documents comprises at least 20 terabytes of information. 16. A system for maintaining a large aggregation of electronically stored documents and making them available to users that submit inquiry messages, comprising: a. at least one data collection for storing documents in electronic form, each document having a unique identifier; b. an intake component for receiving new documents to be added to the at least one data collection and associating with a new document a duplicate comparison signature comprising the document's top n unique inverse document frequency (idf) terms and a document length scalar before storing such new documents as available in the at least one data collection; c. a user interface component for receiving at least one user inquiry message seeking information from the data collection; d. a search component for processing the at least one user inquiry message to identify documents in the data collection that are responsive and retrieving an identifier for documents that are responsive; e. a duplicates detection component for performing comparisons among the duplicate comparison signatures of the documents that are responsive and identifying duplicates when comparison signatures are exactly the same or within a predetermined similarity threshold; and f. a delivery component responsive to a user document request for displaying a requested document. 17. The system of claim 16 wherein the duplicate comparison signature comprises the top n unique idf terms and their relative positions in the document and a document length scalar and n is from four to thirty. 18. The system of claim 16 wherein the duplicate comparison signature comprises the top n unique idf terms and their relative positions in the document and a document length scalar based on tokens, wherein the predetermined similarity threshold with respect to the length scalar is the range 0 to 256 tokens. 19. The system of claim 16 wherein the system employs client-server architecture and the duplicates detection component is on the server side and communicates the identification of duplicates to the client side. 20. The system of claim 16 wherein the system employs client-server architecture and the identification of duplicates to the client side is used to remove the duplicate documents from a search results list communicated to a user. 21. The system of claim 20 wherein on the client side the search results list communicated to the user contains an indication of those documents for which a duplicate was found. 22. The system of claim 20 wherein on the client side the search results list communicated to the user contains an indication of those documents for which a duplicate was found and a set of duplicate documents is made available for a user to access. 23. A system for maintaining a large aggregation of electronically stored documents and making them available to users that submit inquiry messages, comprising: a. at least one data collection for storing documents in electronic form, each document having a unique identifier; b. an intake component for receiving the content of new documents to be added to the at least one data collection and directing enrichment processing of new documents; c. a timestamp component associated with the intake component for locating or placing in a received document at least one PIT field substantially simultaneously with releasing the document for access in the at least one data collection; d. a plurality of resource application components for vending information, each having a user interface component for receiving at least one user inquiry message seeking information from the data collection; e. a search component for processing the at least one user inquiry message to identify documents in the data collection that are responsive and retrieving an identifier for documents that are responsive, said processing and retrieving being responsive to the at least one PIT field to locate a document version responsive to PIT limitations of the inquiry messages; and f. a delivery component responsive to a user document request and a particular resource application receiving the user document request for delivering a located document version with enrichment as determined by the particular resource application. 24. The system of claim 23 wherein the at least one PIT field contains time and date information. 25. The system of claim 23 wherein the at least one PIT field contains version information. 26. The system of claim 23 wherein the at least one PIT field differentiates different versions of legislation.