초록 ▼

A method of automatically correcting dust artifact regions within images acquired by a system including a digital camera includes digitally-acquiring one or more original images with the digital camera. Probabilities that certain pixels correspond to dust artifact regions within the one or more dig

A method of automatically correcting dust artifact regions within images acquired by a system including a digital camera includes digitally-acquiring one or more original images with the digital camera. Probabilities that certain pixels correspond to dust artifact regions within the one or more digitally-acquired images are determined. The dust artifact regions are associated with one or more extracted parameters relating to the optical system when the one or more images were acquired. A statistical dust map is formed including mapped dust regions based on the dust artifact probability determining and associating operations. Pixels corresponding to dust artifact regions within the one or more original images are corrected based on the associated statistical dust map.

대표청구항 ▼

What is claimed is: 1. A method of automatically correcting dust artifact regions within images acquired by a system including a digital camera, comprising: (a) digitally-acquiring one or more original images with said digital camera; (b) determining probabilities that certain pixels correspond to

What is claimed is: 1. A method of automatically correcting dust artifact regions within images acquired by a system including a digital camera, comprising: (a) digitally-acquiring one or more original images with said digital camera; (b) determining probabilities that certain pixels correspond to dust artifact regions within said one or more digitally-acquired images; (c) associating the dust artifact regions with one or more extracted parameters relating to the optical system when the one or more images were acquired; (d) forming a statistical dust map including mapped dust regions based on the dust artifact probability determining and associating; (e) correcting pixels corresponding to dust artifact regions within each of said one or more original images based on the associated statistical dust map. 2. The method of claim 1, said one or more extracted parameters comprising aperture size, F-number, magnification, lens type or focal length of an optical system of the digital camera, or combinations thereof. 3. The method of claim 2, said one or more extracted parameters are calculated empirically from comparison of one or more said dust artifact regions within said multiple original digital images with said digital acquisition device. 4. The method of claim 2, said one or more extracted parameters comprising aperture size or focal length or both. 5. The method of claim 1, further comprising digitally-acquiring further images with said digital camera, repeating said determining and associating, and updating said statistical dust map including updating said mapped dust regions based on the further dust artifact determining and associating. 6. The method of claim 5, further comprising correcting pixels corresponding to correlated dust artifact regions within said further images based on the updated, associated statistical dust map. 7. The method of claim 5, further comprising updating one or more of said one or more original images based on said updating of said associated statistical dust map. 8. The method of claim 5, further comprising repeating for said further digitally-acquired images said determining and associating, and updating said statistical dust map including updating said mapped dust regions based on the additional dust artifact determining and associating. 9. The method of claim 5, further comprising limiting updating one or more of said further and original images based on said updating of said associated statistical dust map to updates that do not include appearance of new dust or movement of existing dust. 10. The method of claim 5, further comprising limiting updating one or more of said further and original images based on said updating of said associated statistical dust map to updates that include previously determined dust artifact regions. 11. The method of claim 5 further comprising creating a version description of changes in said statistical dust map. 12. The method of claim 11, further comprising updating one or more of said further and original images based on said updating of said associated statistical dust map based on said version description. 13. The method of claim 5, wherein said version is based on a chronological time stamp. 14. The method of claim 5, wherein said version is based on replacement of lens. 15. The method of claim 5, wherein said version information comprises change of said probabilities in said statistical dust map that certain pixels correspond to dust artifact regions. 16. The method of claim 5, wherein said version information includes one or more parameters comprising of change in dust location, change in dust position, appearance of new dust region, disappearance of existing dust region. 17. The method of claim 5, wherein further comprising determining whether dust map needs to be replaced based on determining that sufficient disparity exists based amount and quality of said changes in said statistical dust map. 18. The method of claim 1, said image correction method being automatically performed within a digital camera that comprises said optical system, said sensor array, said processing electronics and said memory. 19. The method of claim 1, said image correction method being performed at least in part within an external processing device that couples with a digital camera that comprises said optical system and said sensor array to form a digital image acquisition and processing system that also comprises said processing electronics and said memory. 20. The method of claim 19, the programming instructions being stored on a memory within the external device which performs the image correction method. 21. The method of claim 1, said determining comprising determining probabilities that certain pixels correspond to dust artifact regions within said acquired images based at least in part on a comparison of suspected dust artifact regions within two or more digitally-acquired images, or on a pixel analysis of the suspected dust artifact regions in view of predetermined characteristics indicative of the presence of a dust artifact region, or both. 22. The method of claim 21, further comprising eliminating certain suspected dust artifact regions as having a probability below a first threshold value. 23. The method of claim 22, further comprising judging certain further dust artifact regions as having a probability above said threshold value, such as to be subject to further probability determining including comparison with further acquired images prior to judging whether each said further dust artifact region will be subject to said eliminating operation. 24. The method of claim 22, further comprising judging certain probable dust artifact regions as having a probability above a second threshold value such as to be subject to said correcting operation. 25. The method of claim 24, wherein said first and second threshold values are different. 26. The method of claim 25, further comprising judging certain further dust artifact regions as having a probability between said first and said second threshold values, such as to be subject to further probability determining including comparison with further acquired images prior to judging whether each said further dust artifact region will be subject to said correcting operation. 27. The method of claim 21, further comprising judging certain probable dust artifact regions as having a probability above a threshold value such as to be subject to said correcting operation. 28. The method of claim 27, further comprising judging certain further dust artifact regions as having a probability below said threshold value, such as to be subject to further probability determining including comparison with further acquired images prior to judging whether each said further dust artifact region will be subject to said correcting operation. 29. The method of claim 21, wherein said probability determining includes weighting suspected dust artifact regions according to one or more predetermined probability weighting assessment conditions. 30. The method of claim 29, said one or more weighting assessment conditions comprising size, shape, brightness or opacity of said suspected dust artifact regions, or degree of similarity in size, shape, brightness, opacity or location with one or more suspected dust artifact regions in one or more other images, or combinations thereof. 31. The method of claim 1, wherein said determining is based at least in part on a comparison of suspected dust artifact regions within two or more digitally-acquired images. 32. The method of claim 1, wherein said determining of said probabilities is further based on a pixel analysis of the suspected dust artifact regions in view of predetermined characteristics indicative of the presence of a dust artifact region. 33. The method of claim 1, wherein said suspected dust artifact regions of said at least two images comprise inner regions and aura regions, and wherein said correcting comprises a first correcting of said aura regions and a second correcting of said inner regions. 34. The method of claim 1, the dust map including dust artifact regions with probabilities above a threshold probability and not including regions with lower probabilities. 35. The method of claim 1, the dust map including dust artifact regions with probabilities above a first threshold value, not including regions with probabilities below a second threshold value, and where further regions having a probability between said first and second threshold values exist within said dust map, then further image information is combined into said probability analysis before determining whether said region are included as dust artifact regions. 36. The method of claim 1 wherein said determining probabilities further comprises statistically combining a plurality of individual probabilities based on each said regions within two or more said images. 37. The method of claim 1, further comprising determining probabilities that certain pixels correspond to regions free of dust within said images based at least in part on a comparison of suspected dust artifact regions within one or more of said images. 38. The method of claim 37, further comprising eliminating certain suspected dust artifact based on probabilities that certain pixels correspond to regions free of dust. 39. The method of claim 1, further comprising validating whether said further digitally-acquired image has non contradicting probability data that certain pixels correspond to dust artifact regions within said further digitally-acquired image prior to correcting pixels corresponding to correlated dust artifact regions within further digitally-acquired images based on the associated statistical dust map. 40. The method of claim 1, wherein said suspected dust artifact regions of said further digitally images comprise shadow regions and aura regions. 41. The method of claim 40, said focal length extracted parameters are calculated empirically from comparison of the transposition of said shadow regions of said dust artifact regions within said multiple original digital images with said digital acquisition device. 42. The method of claim 40, said aperture extracted parameters are calculated empirically from comparison of the fall off of said aura regions of said dust artifact regions within said multiple original digital images with said digital acquisition device. 43. The method as recited in claim 40, wherein said correcting comprises a first correcting of said aura regions and a second correction of said shadow regions. 44. The method of claim 40, said determining with respect to a shadow region being based on an extracted parameter-dependent shadow region analysis, wherein the shadow region analysis presumes that certain regions on a sensor of the digital image acquisition device are fully obscured by said dust. 45. The method of claim 44, wherein the shadow region analysis includes calculating effects of differences in values of the one or more extracted parameters in different images on dust artifact illumination, shape, position, reflection or transmission properties, distance of dust to the sensor, aperture, exit pupil, or focal length, or combinations thereof. 46. The method of claim 45, wherein said different images are acquired with different values of said one or more extracted parameters. 47. The method of claim 45, wherein said different images are acquired of different objects. 48. The method of claim 45, wherein said different images are acquired of different scene. 49. The method of claim 40, said determining with respect to an aura region being based on an extracted parameter-dependent aura region analysis, wherein the aura region analysis presumes that certain regions on a of the digital image acquisition device are partially obscured by said dust. 50. The method of claim 49, wherein said aura region analysis includes calculating effects of differences in values of the one or more extracted parameters in different images on dust artifact illumination, shape, position, reflection or transmission properties, distance of dust to the sensor, aperture, exit pupil, or focal length, or combinations thereof. 51. The method of claim 50, wherein said different images are acquired with different values of said one or more extracted parameters. 52. The method of claim 50, wherein said different images are acquired of different objects. 53. The method of claim 40, the correcting operation comprising in-painting or restoration, or both. 54. The method of claim 53, said correcting including in-painting the shadow region. 55. The method of claim 54, said in-painting including determining and applying shadow region correction spectral information based on spectral information obtained from pixels outside said shadow region. 56. The method of claim 53, said correcting including restoration of the aura region. 57. The method of claim 56, said restoration including determining and applying aura region correction spectral information based on spectral information obtained from pixels within said aura region. 58. The method of claim 1, the method being performed on raw image data as captured by a camera sensor. 59. The method of claim 1, said image correction method being performed on a processed image after being converted from raw format to a known red, green, blue representation. 60. The method of claim 1, wherein said correcting includes replacing said pixels within said one or more digitally-acquired images with new pixels. 61. The method of claim 1, wherein said correcting includes enhancing said values of pixels within said one or more digitally-acquired images. 62. The method of claim 1, wherein correcting instructions are kept in an external location to the image data. 63. The method of claim 1, said external location comprising an image header. 64. The method of claim 1, the dust artifact determining operation including: (I) loading the statistical dust map; (II) loading extracted parameter information of a present image; (III) performing calculations within the statistical dust map having extracted parameter variable-dependencies; and (IV) comparing dust artifact detection data with the extracted parameter dependent statistical dust map data. 65. The method of claim 64, the extracted parameter information including values of aperture size and focal length. 66. The method of claim 65, the extracted parameter information further including lens type information. 67. The method of claim 1, the dust artifact determining operation including: (I) loading the statistical dust map; (II) loading extracted parameter information of a present image; (III) performing a calculation for relating the statistical dust map with the present image according to a selected value of an extracted parameter which is otherwise uncorrelated between the present image and the dust map; and (IV) comparing dust artifact detection data with the now correlated statistical dust map data. 68. The method of claim 1, wherein said suspected dust artifact regions of said at least two images comprise inner regions and aura regions, and wherein said comparison comprises a first comparison of said inner regions and a second comparison of said aura regions. 69. The method of claim 68, said dust artifact regions including an aura region partially obscured by dust and a shadow region substantially obscured by dust inside said aura region. 70. The method of claim 69, said determining with respect to a shadow region being based on an extracted parameter-dependent shadow region analysis, wherein the shadow region analysis presumes that certain regions on a sensor of the digital image acquisition device are fully obscured by said dust. 71. The method of claim 70, wherein the shadow region analysis includes calculating effects of differences in values of the one or more extracted parameters in different images on dust artifact illumination, shape, position, reflection or transmission properties, distance of dust to the sensor, aperture, exit pupil, or focal length, or combinations thereof. 72. The method of claim 71, said different images having been acquired of different objects. 73. The method of claim 71, wherein said different images are acquired of different scene. 74. The method of claim 69, said determining with respect to an aura region being based on an extracted parameter-dependent aura region analysis, wherein the aura region analysis presumes that certain regions on a of the digital image acquisition device are partially obscured by said dust. 75. The method of claim 74, wherein said aura region analysis includes calculating effects of differences in values of the one or more extracted parameters in different images on dust artifact illumination, shape, position, reflection or transmission properties, distance of dust to the sensor, aperture, exit pupil, or focal length, or combinations thereof. 76. The method of claim 75, said different images having been acquired of different objects. 77. The method of claim 69, the correcting operation comprising in-painting or restoration, or both. 78. The method of claim 77, said correcting including in-painting the shadow region. 79. The method of claim 78, said in-painting including determining and applying shadow region correction spectral information based on spectral information obtained from pixels outside said shadow region. 80. The method of claim 77, said correcting including restoration of the aura region. 81. The method of claim 80, said restoration including determining and applying aura region correction spectral information based on spectral information obtained from pixels within said aura region. 82. The method of claim 1, further comprising sorting dust artifact distribution data within said dust map according to meta-data.