초록 ▼

An automatic mining system that identifies a set of relevant terms from a large text database of unstructured information, such as the World Wide Web with a high degree of confidence. The automatic mining system includes a software program that enables the discovery of new relationships by associati

An automatic mining system that identifies a set of relevant terms from a large text database of unstructured information, such as the World Wide Web with a high degree of confidence. The automatic mining system includes a software program that enables the discovery of new relationships by association mining and refinement of co-occurrences, using automatic and iterative recognition of new binary relations through phrases that embody related pairs, by applying lexicographic and statistical techniques to classify the relations, and further by applying a minimal amount of domain knowledge of the relevance of the terms and relations. The automatic mining system includes a knowledge module and a statistics module. The knowledge module is comprised of a stemming unit, a synonym check unit, and a domain knowledge check unit. The stemming unit determines if the relation being analyzed shares a common root with a previously mined relation. The synonym check unit identifies the synonyms of the relation, and the domain knowledge check unit considers extrinsic factors for indications that would further clarify the relationship being mined. The statistics module optimizes the confidence level in the relationship.

대표청구항 ▼

An automatic mining system that identifies a set of relevant terms from a large text database of unstructured information, such as the World Wide Web with a high degree of confidence. The automatic mining system includes a software program that enables the discovery of new relationships by associati

An automatic mining system that identifies a set of relevant terms from a large text database of unstructured information, such as the World Wide Web with a high degree of confidence. The automatic mining system includes a software program that enables the discovery of new relationships by association mining and refinement of co-occurrences, using automatic and iterative recognition of new binary relations through phrases that embody related pairs, by applying lexicographic and statistical techniques to classify the relations, and further by applying a minimal amount of domain knowledge of the relevance of the terms and relations. The automatic mining system includes a knowledge module and a statistics module. The knowledge module is comprised of a stemming unit, a synonym check unit, and a domain knowledge check unit. The stemming unit determines if the relation being analyzed shares a common root with a previously mined relation. The synonym check unit identifies the synonyms of the relation, and the domain knowledge check unit considers extrinsic factors for indications that would further clarify the relationship being mined. The statistics module optimizes the confidence level in the relationship. etrieved record. 2. A system of contextual searching, comprising: a search engine for searching a set of documents according to a first criterion, to obtain a first set of results; a category lookup engine for defining a subset of the set of documents according to a parameter, to obtain a second set of results; and an intersection engine for defining a third set of results comprising an intersection of the first set of results and the second set of results, wherein the intersection engine comprises a document identifier for, for each document in the first set of results, identifying whether the document exists in the second set of results. 3. A system of contextual searching, comprising: a search engine for searching a set of documents according to a first criterion, to obtain a first set of results; a category lookup engine for defining a subset of the set of documents according to a parameter, to obtain a second set of results; and an intersection engine for defining a third set of results comprising an intersection of the first set of results and the second set of results, the intersection engine comprising a document identifier for, for each document in the first set of results, identifying whether the document exists in the second set of results, the document identifier comprising: a primary hash function application module, for applying a primary hash function to an identifier for the document to obtain a primary hash key for the identifier; a hash bucket identification module, coupled to the primary hash function application module, for identifying a hash bucket having a primary hash key corresponding to the obtain primary hash key, the hash bucket comprising at least one hash entry, each hash entry comprising a secondary hash key and a pointer to a record location in the second set of results; a secondary hash function application module, for applying a secondary hash function to the identifier to obtain a secondary hash key for the identifier; a comparator, coupled to the secondary hash function application module and to the hash bucket identification module, for comparing the secondary hash key for the identifier with the secondary hash key for at least one hash entry in the identified hash bucket; a retrieval module, coupled to the comparison means, for, responsive to the comparison module indicating at least one match, retrieving a record in the second set of results having a location corresponding to the value in the matching hash entry; and a second comparator, coupled to the retrieval module, for comparing the identifier with the retrieved record. 4. A system of contextual searching, comprising: search means, for searching a set of documents according to a first criterion to obtain a first set of results; subset definition means, coupled to the search means, for defining a subset of the set of documents according to a parameter to obtain a second set of results; and result definition means, coupled to the search means and to the subset definition means, for defining a third set of results comprising an intersection of the first set of results and the second set of results. 5. The system of claim 4, wherein: the search means comprises means for performing a text search on the set of documents; and the subset definition means comprises means for defining the subset of the set of documents according to a specified category. 6. The system of claim 4, wherein the result definition means comprises: identifying means for, for each document in the first set of results, identifying whether the document exists in the second set of results. 7. A system of contextual searching, comprising: search means, for searching a set of documents according to a first criterion to obtain a first set of results; subset definition means, coupled to the search means, for defining a subset of the set of documents according to a parameter to obtain a second set of results; and result definitio