Scoring attributes in deep question answering systems based on algorithmic source code influences
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06N-005/04
G06N-099/00
G06N-005/02
출원번호
US-0862212
(2015-09-23)
등록번호
US-10120910
(2018-11-06)
발명자
/ 주소
Allen, Corville O.
Delima, Roberto
Eggebraaten, Thomas J.
Setnes, Marie L.
출원인 / 주소
International Business Machines Corporation
대리인 / 주소
Patterson + Sheridan, LLP
인용정보
피인용 횟수 :
0인용 특허 :
7
초록▼
Methods to perform an operation comprising: identifying a first attribute of a source code in a deep question answering system, computing an influence score for the first attribute based on a rule in the source code used to compute a confidence score for each of a plurality of candidate answers gene
Methods to perform an operation comprising: identifying a first attribute of a source code in a deep question answering system, computing an influence score for the first attribute based on a rule in the source code used to compute a confidence score for each of a plurality of candidate answers generated by the deep question answering system, computing an importance score for the first attribute based at least in part on the computed influence score, and upon determining that the importance score exceeds a predefined threshold, storing an indication that the first attribute is an important attribute relative to other attributes specified in the source code.
대표청구항▼
1. A method, comprising: identifying a first variable in a source code of a question answering (QA) system;upon determining that a weight applied to a value of the first variable by a first rule in the source code increases a confidence score for candidate answers generated by the QA system beyond a
1. A method, comprising: identifying a first variable in a source code of a question answering (QA) system;upon determining that a weight applied to a value of the first variable by a first rule in the source code increases a confidence score for candidate answers generated by the QA system beyond a threshold; computing an influence score for the first variable based on: (i) the weight applied to the value of the variable by the first rule in the source code, (ii) a number of rules specifying weights applied to values of the first attribute, (iii) a location of the first attribute in each rule, (iv) a number of times the first variable is used in each rule, (v) a type of operation applied to the value of the first variable by each respective rule, and (vi) an identified phase of a processing pipeline of the QA system in which each respective rule is applied;computing an importance score for the first variable based at least in part on the computed influence score; andupon determining that the importance score exceeds a predefined threshold, storing an indication that the first variable is an important variable relative to other variables specified in the source code;receiving, by the QA system, a case that does not specify a value for the first variable; andrefraining, by the QA system, from processing the case. 2. The method of claim 1, further comprising: outputting, to a user, a request to provide a value for the first variable;receiving, from the user, a first value for the variable; andprocessing, by the QA system, the case using the first value for the variable. 3. The method of claim 1, wherein the influence score for the first variable is further based on a respective weight applied to each of a plurality of possible values for the first variable specified in the first rule. 4. The method of claim 1, wherein the first variable is identified during a code scan of the source code of each of a plurality of scorers configured to compute confidence scores for candidate answers in the QA system. 5. The method of claim 1, wherein the confidence score specifies a level of confidence that a response to a case generated by the deep question answering system is correct, wherein the source code comprises a current source code of the QA system. 6. The method of claim 1, further comprising: identifying a second variable in the source code of the QA system;determining that a weight applied to a value of the second variable by a second rule in the source code increases the confidence score for candidate answers generated by the QA system beyond the threshold;computing an influence score for the second variable based on the weight applied to the value of the second variable by the second rule in the source code;computing an importance score for the second variable based at least in part on the computed influence score for the second variable; anddetermining that the importance score exceeds the predefined threshold. 7. The method of claim 6, further comprising: receiving, by the QA system, a case that does not specify values for at least the first and second variables;determining that the importance score for the first variable is greater than the importance for the second variable; andoutputting, to a user, a request to provide values for the first and second variables, wherein the request is ordered based on the importance score of the first variable being greater than the importance score of the second variable. 8. The method of claim 7, wherein the case does not specify values for a plurality of variables including the first and second variables, the method further comprising: generating an ordered list of the plurality of variables, wherein the list is ordered according to the importance score of each variable;outputting the ordered list to the user;receiving, from the user, values for each of the plurality of variables; and processing, by the QA system, the case based on the values for each of the plurality of variables provided by the user.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (7)
Amirghodsi Siamak (Prairie View IL) Daneshbodi Farnoud (Prairie View IL), Adaptive natural language computer interface system.
Vivek Wadhwa ; Len Erlikh ; Ioan M Oara ; Andrey N. Terekhov RU; Mikhail Bulyonkov RU, Method and system of business rule extraction from existing applications for integration into new applications.
Dumais Susan T. ; Heckerman David ; Horvitz Eric ; Platt John Carlton ; Sahami Mehran, Methods and apparatus for classifying text and for building a text classifier.
Sterne, Brendan; Friesenhahn, Dustin; Sedota, Jr., Donald J., System, method and computer program product for identifying products associated with polarized sentiments.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.