초록 ▼

Mapping one or more elements of an input dataset to one or more elements of an output dataset includes: receiving in an interface one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transf

Mapping one or more elements of an input dataset to one or more elements of an output dataset includes: receiving in an interface one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on a data processing system, the transformational expression defining an output of a mapped relationship based on at least one input variable mapped to an element of an input dataset; receiving in the interface identification of elements of an output dataset mapped to outputs of respective mapped relationships; generating output data from the data processing system according to the transformational expression based on input data from the input dataset associated with the element of the input dataset mapped to the input variable; determining validation information in response to the generated output data based on validation criteria defining one or more characteristics of valid values associated with one or more of the identified elements of the output dataset; and presenting in the interface visual feedback based on the determined validation information.

대표청구항 ▼

1. A method for presenting visual feedback in an interface, the method including: receiving one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on a

1. A method for presenting visual feedback in an interface, the method including: receiving one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on a data processing system, the transformational expression defining an output of a mapped relationship based on at least one input variable mapped to an element of an input dataset;receiving identification of elements of an output dataset mapped to outputs of respective mapped relationships;generating output data from the data processing system according to the transformational expression based on input data from the input dataset associated with the element of the input dataset mapped to the input variable;determining validation information in response to the generated output data based on validation criteria defining one or more characteristics of valid values associated with one or more of the identified elements of the output dataset; andpresenting in the interface visual feedback based on the determined validation information, the visual feedback including at least one indicator based on validation information for at least one transformed value associated with the one or more identified elements of the output dataset. 2. The method of claim 1, further including importing input data from the input dataset into the output dataset according to the mapped relationships. 3. The method of claim 2, wherein importing the input data includes applying the transformational expressions to input values in respective fields of input records of the input dataset and storing output values in respective fields of output records of the output dataset, where at least some fields of the input records correspond to the elements of the input dataset mapped to the input variables and at least some fields of the output records correspond to the elements of the output dataset mapped to outputs of respective mapped relationships. 4. The method of claim 3, wherein applying the transformational expressions to input values in respective fields of input records of the input dataset and storing output values in respective fields of output records of the output dataset includes executing a dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input records, and a node representing the output dataset receiving a data flow of the output records. 5. The method of claim 1, further including storing a mapping specifying the mapped relationships. 6. The method of claim 1, wherein determining the validation information includes retrieving a stored specification of the validation criteria. 7. The method of claim 6, wherein the interface is provided by the data processing system and is presented to a first user, and the specification of the validation criteria is received from a second user. 8. The method of claim 1, further including presenting in the interface a value representing the generated output data. 9. The method of claim 1, wherein determining the validation information includes evaluating output data generated for each transforming mapped relationship that includes a transformational expression, based on the validation criteria associated with the identified elements of the output dataset mapped to the outputs of the transforming mapped relationships. 10. The method of claim 9, wherein the mapped relationships include multiple transforming mapped relationships that include transformational expressions. 11. The method of claim 9, wherein the validation criteria include a first validation criterion associated with a first identified element of the output data set that defines one or more characteristics of valid values associated with the first identified element, and a second validation criterion associated with a second identified element of the output data set that defines one or more characteristics of valid values associated with the second identified element. 12. The method of claim 11, wherein validation information is determined in response to a generated output record that includes a first field corresponding to the first identified element and a second field corresponding to the second identified element. 13. The method of claim 12, wherein the first validation criterion depends on a value in the second field of the output record. 14. The method of claim 12, wherein the validation information depends on a value in the first field of the output record and a value in the second field of the output record. 15. The method of claim 1, further including determining syntax information indicating valid structure for a transformational expression. 16. The method of claim 15, further including presenting in the interface visual feedback based on the determined syntax information. 17. The method of claim 1, further including accepting a modified transformational expression based on received user modifications to the transformational expression. 18. The method of claim 17, further including generating modified output data from the data processing system according to the modified transformational expression based on the input data from the input dataset. 19. The method of claim 18, further including determining modified validation information in response to the generated modified output data and presenting in the interface visual feedback based on the modified validation information. 20. The method of claim 19, wherein generating the modified output data and presenting the visual feedback based on the modified validation information occurs while the transformational expression is being modified. 21. The method of claim 19, wherein generating the modified output data and presenting the visual feedback based on the modified validation information occurs in response to a user request after the transformational expression has been modified. 22. The method of claim 1, wherein the input data from the input dataset is received according to a link representing a flow of data to a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 23. The method of claim 1, wherein the generated output data stored in the output dataset is provided to the output dataset according to a link representing a flow of data from a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 24. The method of claim 1, wherein at least a first mapped relationship is received in response to a selection of a component of a dataflow graph that applies the first mapped relationship, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output records. 25. The method of claim 1, wherein the visual feedback includes an indicator representing validation information for one of a plurality of nodes of a lineage diagram displayed on the interface, the nodes representing transformed values that include at least one transformed value associated with the one or more identified elements of the output dataset. 26. The method of claim 25, wherein the visual feedback includes a plurality of indicators each associated with a node among the plurality of nodes of the lineage diagram displayed on the interface. 27. The method of claim 26, wherein at least some of the nodes associated with the indicators are connected by links representing dependencies between the transformed values represented by the nodes. 28. The method of claim 1, wherein the visual feedback includes a plurality of indicators each associated with an output element among a plurality of output elements displayed on the interface that include at least one output element representing the one or more identified elements of the output dataset. 29. The method of claim 28, wherein the plurality of output elements displayed on the interface correspond to fields representing results of application of transformational expressions to records of the input data. 30. The method of claim 29 wherein at least one indicator indicates validation information for a row of values for the fields, the row representing output values resulting from application of transformational expressions to a single record of the input data. 31. The method of claim 29 wherein at least one indicator indicates validation information for a column of values for a field, the column representing a plurality of applications of a single transformational expression to respective records of the input data. 32. The method of claim 1, wherein the visual feedback includes statistics computed based on the validation information, the statistics including data representing results of application of the validation criteria to multiple records of the input data. 33. The method of claim 32, wherein the statistics are calculated at regular time intervals. 34. The method of claim 1, wherein the visual feedback includes a custom error message associated with the validation criteria, the custom error message indicating information about a result of a particular instance of application of the validation criteria to a record of the input data. 35. The method of claim 1, further including receiving in the interface an output defined as at least one constant independent of the input variables. 36. The method of claim 1, further including receiving expected values representing results of transformational expressions, and wherein determining the validation information includes comparing the expected values to output data generated for each transforming mapped relationship that includes a transformational expression. 37. The method of claim 1 in which the validation criteria include a set of validation rules each defining one or more characteristics of valid values associated with one or more of the identified elements of an output dataset. 38. The method of claim 37 in which the validation rules indicate types of output data that are accepted as valid according to a desired format of an output dataset. 39. The method of claim 1 in which at least some of the validation criteria specify constraints on formatting of elements of an output dataset. 40. The method of claim 1 in which at least some of the validation criteria specify characteristics of valid values based on dependencies among multiple elements of an output dataset. 41. The method of claim 1 in which at least some of the validation criteria reference a data structure that indicates valid values for data represented in multiple formats, the multiple formats corresponding to respective formats of elements of an output dataset. 42. A system for presenting visual feedback in an interface, the system including: an input data storage system storing an input dataset;an output data storage system storing an output dataset; anda data processing system configured to provide an interface for receiving user input and presenting results of data processing, including receiving one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on the data processing system, the transformational expression defining an output of a mapped relationship based on at least one input variable mapped to an element of the input dataset;receiving identification of elements of the output dataset mapped to outputs of respective mapped relationships;generating output data from the data processing system according to the transformational expression based on input data from the input dataset associated with the element of the input dataset mapped to the input variable;determining validation information in response to the generated output data based on validation criteria defining one or more characteristics of valid values associated with one or more of the identified elements of the output dataset; andpresenting in the interface visual feedback based on the determined validation information, the visual feedback including at least one indicator based on validation information for at least one transformed value associated with the one or more identified elements of the output dataset. 43. The system of claim 42, further including importing input data from the input dataset into the output dataset according to the mapped relationships. 44. The system of claim 43, wherein importing the input data includes applying the transformational expressions to input values in respective fields of input records of the input dataset and storing output values in respective fields of output records of the output dataset, where at least some fields of the input records correspond to the elements of the input dataset mapped to the input variables and at least some fields of the output records correspond to the elements of the output dataset mapped to outputs of respective mapped relationships. 45. The system of claim 44, wherein the interface is provided by the data processing system and is presented to a first user, and the specification of the validation criteria is received from a second user. 46. The system of claim 42, further including presenting in the interface a value representing the generated output data. 47. The system of claim 42, wherein determining the validation information includes evaluating output data generated for each transforming mapped relationship that includes a transformational expression, based on the validation criteria associated with the identified elements of the output dataset mapped to the outputs of the transforming mapped relationships. 48. The system of claim 47, wherein the mapped relationships include multiple transforming mapped relationships that include transformational expressions. 49. The system of claim 48, wherein the validation criteria include a first validation criterion associated with a first identified element of the output data set that defines one or more characteristics of valid values associated with the first identified element, and a second validation criterion associated with a second identified element of the output data set that defines one or more characteristics of valid values associated with the second identified element. 50. The system of claim 42, further including determining syntax information indicating valid structure for a transformational expression, further including presenting in the interface visual feedback based on the determined syntax information. 51. The system of claim 42, further including accepting a modified transformational expression based on received user modifications to the transformational expression, further including generating modified output data from the data processing system according to the modified transformational expression based on the input data from the input dataset, further including determining modified validation information in response to the generated modified output data and presenting in the interface visual feedback based on the modified validation information. 52. The system of claim 42, wherein the input data from the input dataset is received according to a link representing a flow of data to a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 53. The system of claim 42, wherein the generated output data stored in the output dataset is provided to the output dataset according to a link representing a flow of data from a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 54. The system of claim 42, wherein at least a first mapped relationship is received in response to a selection of a component of a dataflow graph that applies the first mapped relationship, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output records. 55. The system of claim 42, wherein the visual feedback includes an indicator representing validation information for one of a plurality of nodes of a lineage diagram displayed on the interface, the nodes representing transformed values that include at least one transformed value associated with the one or more identified elements of the output dataset. 56. The system of claim 55, wherein the visual feedback includes a plurality of indicators each associated with a node among the plurality of nodes of the lineage diagram displayed on the interface. 57. The system of claim 56, wherein at least some of the nodes associated with the indicators are connected by links representing dependencies between the transformed values represented by the nodes. 58. The system of claim 42, wherein the visual feedback includes a plurality of indicators each associated with an output element among a plurality of output elements displayed on the interface that include at least one output element representing the one or more identified elements of the output dataset. 59. The system of claim 58, wherein the plurality of output elements displayed on the interface correspond to fields representing results of application of transformational expressions to records of the input data. 60. The system of claim 59 wherein at least one indicator indicates validation information for a row of values for the fields, the row representing output values resulting from application of transformational expressions to a single record of the input data. 61. The system of claim 60 wherein at least one indicator indicates validation information for a column of values for a field, the column representing a plurality of applications of a single transformational expression to respective records of the input data. 62. The system of claim 42, wherein the visual feedback includes statistics computed based on the validation information, the statistics including data representing results of application of the validation criteria to multiple records of the input data. 63. The system of claim 62, wherein the statistics are calculated at regular time intervals. 64. The system of claim 42, wherein the visual feedback includes a custom error message associated with the validation criteria, the custom error message indicating information about a result of a particular instance of application of the validation criteria to a record of the input data. 65. The system of claim 42, further including receiving in the interface an output defined as at least one constant independent of the input variables. 66. The system of claim 42, further including receiving expected values representing results of transformational expressions, and wherein determining the validation information includes comparing the expected values to output data generated for each transforming mapped relationship that includes a transformational expression. 67. The system of claim 42, in which the validation criteria include a set of validation rules each defining one or more characteristics of valid values associated with one or more of the identified elements of an output dataset. 68. The system of claim 67 in which the validation rules indicate types of output data that are accepted as valid according to a desired format of an output dataset. 69. The system of claim 42, in which at least some of the validation criteria specify constraints on formatting of elements of an output dataset. 70. The system of claim 42, in which at least some of the validation criteria specify characteristics of valid values based on dependencies among multiple elements of an output dataset. 71. The system of claim 42, in which at least some of the validation criteria reference a data structure that indicates valid values for data represented in multiple formats, the multiple formats corresponding to respective formats of elements of an output dataset. 72. A system for presenting visual feedback in an interface, the system including: means for storing an input dataset;means for storing an output dataset; andmeans for providing an interface for receiving user input and presenting results of data processing, including receiving one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on a data processing system, the transformational expression defining an output of a mapped relationship based on at least one input variable mapped to an element of the input dataset;receiving identification of elements of the output dataset mapped to outputs of respective mapped relationships;generating output data from the data processing system according to the transformational expression based on input data from the input dataset associated with the element of the input dataset mapped to the input variable;determining validation information in response to the generated output data based on validation criteria defining one or more characteristics of valid values associated with one or more of the identified elements of the output dataset; andpresenting in the interface visual feedback based on the determined validation information, the visual feedback including at least one indicator based on validation information for at least one transformed value associated with the one or more identified elements of the output dataset. 73. A computer-readable storage device storing a computer program for presenting visual feedback in an interface, the computer program including instructions for causing a computer to: receive one or more mapped relationships between a given output and one or more inputs represented by input variables, at least one of the mapped relationships including a transformational expression executable on a data processing system, the transformational expression defining an output of a mapped relationship based on at least one input variable mapped to an element of an input dataset;receive identification of elements of an output dataset mapped to outputs of respective mapped relationships;generate output data from the data processing system according to the transformational expression based on input data from the input dataset associated with the element of the input dataset mapped to the input variable;determine validation information in response to the generated output data based on validation criteria defining one or more characteristics of valid values associated with one or more of the identified elements of the output dataset; andpresent in the interface visual feedback based on the determined validation information, the visual feedback including at least one indicator based on validation information for at least one transformed value associated with the one or more identified elements of the output dataset. 74. The computer-readable medium of claim 73, further including importing input data from the input dataset into the output dataset according to the mapped relationships. 75. The computer-readable medium of claim 74, wherein importing the input data includes applying the transformational expressions to input values in respective fields of input records of the input dataset and storing output values in respective fields of output records of the output dataset, where at least some fields of the input records correspond to the elements of the input dataset mapped to the input variables and at least some fields of the output records correspond to the elements of the output dataset mapped to outputs of respective mapped relationships. 76. The computer-readable medium of claim 75, wherein the interface is provided by the data processing system and is presented to a first user, and the specification of the validation criteria is received from a second user. 77. The computer-readable medium of claim 73, further including presenting in the interface a value representing the generated output data. 78. The computer-readable medium of claim 73, wherein determining the validation information includes evaluating output data generated for each transforming mapped relationship that includes a transformational expression, based on the validation criteria associated with the identified elements of the output dataset mapped to the outputs of the transforming mapped relationships. 79. The computer-readable medium of claim 78, wherein the mapped relationships include multiple transforming mapped relationships that include transformational expressions. 80. The computer-readable medium of claim 78, wherein the validation criteria include a first validation criterion associated with a first identified element of the output data set that defines one or more characteristics of valid values associated with the first identified element, and a second validation criterion associated with a second identified element of the output data set that defines one or more characteristics of valid values associated with the second identified element. 81. The computer-readable medium of claim 73, further including determining syntax information indicating valid structure for a transformational expression, further including presenting in the interface visual feedback based on the determined syntax information. 82. The computer-readable medium of claim 81, further including accepting a modified transformational expression based on received user modifications to the transformational expression, further including generating modified output data from the data processing system according to the modified transformational expression based on the input data from the input dataset, further including determining modified validation information in response to the generated modified output data and presenting in the interface visual feedback based on the modified validation information. 83. The computer-readable medium of claim 73, wherein the input data from the input dataset is received according to a link representing a flow of data to a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 84. The computer-readable medium of claim 73, wherein the generated output data stored in the output dataset is provided to the output dataset according to a link representing a flow of data from a component of a dataflow graph that applies the transformational expression, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output data. 85. The computer-readable medium of claim 73, wherein at least a first mapped relationship is received in response to a selection of a component of a dataflow graph that applies the first mapped relationship, the dataflow graph including nodes representing data processing components, links representing data flows between the data processing components, a node representing the input dataset providing a data flow of the input data, and a node representing the output dataset receiving a data flow of the output records. 86. The computer-readable medium of claim 73, wherein the visual feedback includes an indicator representing validation information for one of a plurality of nodes of a lineage diagram displayed on the interface, the nodes representing transformed values that include at least one transformed value associated with the one or more identified elements of the output dataset. 87. The computer-readable medium of claim 86, wherein the visual feedback includes a plurality of indicators each associated with a node among the plurality of nodes of the lineage diagram displayed on the interface. 88. The computer-readable medium of claim 87, wherein at least some of the nodes associated with the indicators are connected by links representing dependencies between the transformed values represented by the nodes. 89. The computer-readable medium of claim 73, wherein the visual feedback includes a plurality of indicators each associated with an output element among a plurality of output elements displayed on the interface that include at least one output element representing the one or more identified elements of the output dataset. 90. The computer-readable medium of claim 89, wherein the plurality of output elements displayed on the interface correspond to fields representing results of application of transformational expressions to records of the input data. 91. The computer-readable medium of claim 90 wherein at least one indicator indicates validation information for a row of values for the fields, the row representing output values resulting from application of transformational expressions to a single record of the input data. 92. The computer-readable medium of claim 91 wherein at least one indicator indicates validation information for a column of values for a field, the column representing a plurality of applications of a single transformational expression to respective records of the input data. 93. The computer-readable medium of claim 73, wherein the visual feedback includes statistics computed based on the validation information, the statistics including data representing results of application of the validation criteria to multiple records of the input data. 94. The computer-readable medium of claim 93, wherein the statistics are calculated at regular time intervals. 95. The computer-readable medium of claim 73, wherein the visual feedback includes a custom error message associated with the validation criteria, the custom error message indicating information about a result of a particular instance of application of the validation criteria to a record of the input data. 96. The computer-readable medium of claim 73, further including receiving in the interface an output defined as at least one constant independent of the input variables. 97. The computer-readable medium of claim 73, further including receiving expected values representing results of transformational expressions, and wherein determining the validation information includes comparing the expected values to output data generated for each transforming mapped relationship that includes a transformational expression. 98. The computer-readable medium of claim 73, in which the validation criteria include a set of validation rules each defining one or more characteristics of valid values associated with one or more of the identified elements of an output dataset. 99. The computer-readable medium of claim 98 in which the validation rules indicate types of output data that are accepted as valid according to a desired format of an output dataset. 100. The computer-readable medium of claim 73, in which at least some of the validation criteria specify constraints on formatting of elements of an output dataset. 101. The computer-readable medium of claim 73, in which at least some of the validation criteria specify characteristics of valid values based on dependencies among multiple elements of an output dataset. 102. The computer-readable medium of claim 73, in which at least some of the validation criteria reference a data structure that indicates valid values for data represented in multiple formats, the multiple formats corresponding to respective formats of elements of an output dataset.