Systems and methods for mobile image capture and processing
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/40
G06T-011/20
G06F-003/00
H04N-001/40
G06T-005/00
G06T-007/00
G06T-003/00
G06F-017/40
H04N-001/387
출원번호
US-0740131
(2013-01-11)
등록번호
US-8989515
(2015-03-24)
발명자
/ 주소
Shustorovich, Alexander
Macciola, Anthony
Thrasher, Christopher W.
출원인 / 주소
Kofax, Inc.
대리인 / 주소
Zilka-Kotab, PC
인용정보
피인용 횟수 :
46인용 특허 :
253
초록▼
In various embodiments, methods, systems, and computer program products for processing digital images captured by a mobile device are disclosed. Myriad features enable and/or facilitate processing of such digital images using a mobile device that would otherwise be technically impossible or impracti
In various embodiments, methods, systems, and computer program products for processing digital images captured by a mobile device are disclosed. Myriad features enable and/or facilitate processing of such digital images using a mobile device that would otherwise be technically impossible or impractical, and furthermore address unique challenges presented by images captured using a camera rather than a traditional flat-bed scanner, paper-feed scanner or multifunction peripheral.
대표청구항▼
1. A method for determining whether illumination problems exist in a digital representation of a document, the method comprising: dividing, using a processor, a tetragon comprising a detected digital representation of a document within the digital image into a plurality of sections, each section com
1. A method for determining whether illumination problems exist in a digital representation of a document, the method comprising: dividing, using a processor, a tetragon comprising a detected digital representation of a document within the digital image into a plurality of sections, each section comprising a plurality of pixels;determining a distribution of brightness values of each section;determining a brightness value range of each section;determining a variability of brightness values of each section;determining whether each section is oversaturated;determining whether each section is undersaturated;determining a number of oversaturated sections;determining a number of undersaturated sections;determining that the digital image is oversaturated upon determining that a ratio of the number of oversaturated sections to a total number of sections exceeds an oversaturation threshold;determining that the digital image is undersaturated upon determining that a ratio of the number of undersaturated sections to the total number of sections exceeds an undersaturation threshold; anddetermining that the illumination problem exists in the digital image upon determining that the digital image is either undersaturated or oversaturated. 2. The method as recited in claim 1, further comprising: determining a section oversaturation ratio for each section, each section oversaturation ratio comprising a number of pixels exhibiting a maximum brightness value in the section divided by a total number of pixels in the section. 3. The method as recited in claim 2, further comprising: determining, for each section, whether the oversaturation level of the section is greater than a predetermined threshold: andcharacterizing the section as oversaturated upon determining that the saturation level of the section is greater than a predetermined threshold. 4. The method as recited in claim 1, further comprising: determining a median variability of the distribution of brightness values of each section;determining whether each median variability is greater than a predetermined variability threshold; anddetermining, for each section, that the section is undersaturated upon determining that the median variability of the section is greater than the predetermined variability threshold. 5. The method as recited in claim 1, wherein the brightness value range of each section comprises a difference between: a maximum characteristic brightness value in the distribution of brightness values of the section; anda minimum characteristic brightness value in the distribution of brightness values of the section. 6. The method as recited in claim 1, wherein each brightness value is an integer value in a range from 0 to 255. 7. The method as recited in claim 1, wherein determining the variability comprises: determining a brightness value of a target pixel in the plurality of pixels;calculating a difference between the brightness value of the target pixel and a brightness value for one or more neighboring pixels, each neighboring pixel being one or more pixels away from the target pixel;repeating the determining and the calculating for each pixel in the plurality of pixels to obtain each target pixel variability; andgenerating a distribution of target pixel variability values,wherein each target pixel variability value is an integer in a range from 0 to 255. 8. The method as recited in claim 7, wherein the one or more neighboring pixels are located within five pixels of the target pixel along a vertical direction. 9. The method as recited in claim 7, wherein the one or more neighboring pixels are located within five pixels of the target pixel along a horizontal direction. 10. The method as recited in claim 7, further comprising: removing one or more target pixel variability values from the distribution of target pixel variability values to generate a corrected distribution; anddefining a characteristic background variability based on the corrected distribution. 11. The method as recited in claim 1, further comprising, for each section: defining a section height by dividing the height of the document into a predefined number of horizontal sections; anddefining a section width by dividing the width of the document into a predetermined number of vertical sections. 12. The method as recited in claim 1, wherein each section is characterized by a section height and width, wherein the digital image is characterized by an image width w and an image height h,wherein h>=w,wherein the section size is characterized by a section width ws and a section height hs wherein ws =w/m,wherein hs =h/n,wherein m and n are defined so that ws is approximately equal to hs. 13. A method for determining whether illumination problems exist in a digital representation of a document, comprising: dividing, using a processor, a tetragon comprising a detected digital representation of a document within a digital image into a plurality of sections, each section comprising a plurality of pixels;determining a distribution of brightness values of each section;determining a brightness value range of each section;determining a variability of brightness values of each section;determining a section oversaturation ratio for each section, each section oversaturation ratio comprising a number of pixels exhibiting a maximum brightness value in the section divided by a total number of pixels in the section;determining, for each section, whether the oversaturation ratio of the section is greater than a predetermined oversaturation threshold;determining, for each section, that the section is oversaturated upon determining that the saturation level of the section is greater than a predetermined oversaturation threshold;determining, for each section, a median variability of the distribution of brightness values of the section;determining whether each median variability is greater than a predetermined median variability threshold; anddetermining, for each section, that the section is undersaturated upon determining that the median variability of the section is greater than the predetermined median variability threshold; anddetermining that the illumination problem exists in the digital image upon determining that the digital image is either undersaturated or oversaturated. 14. The method as recited in claim 1, wherein the processor is part of a mobile device, the mobile device having an integrated camera. 15. A system, comprising: a processor configured to execute logic;logic for dividing a tetragon comprising a detected digital representation of a document within the digital image into a plurality of sections, each section comprising a plurality of pixels;logic for determining a distribution of brightness values of each section;logic for determining a brightness value range of each section;logic for determining a variability of brightness values of each section;logic for determining whether each section is oversaturated;logic for determining whether each section is undersaturated;logic for determining a number of oversaturated sections;logic for determining a number of undersaturated sections;logic for determining that the digital image is oversaturated upon determining that a ratio of the number of oversaturated sections to a total number of sections exceeds an oversaturation threshold;logic for determining that the digital image is undersaturated upon determining that a ratio of the number of undersaturated sections to the total number of sections exceeds an undersaturation threshold; andlogic for determining that the illumination problem exists in the digital image upon determining that the digital image is either undersaturated or oversaturated. 16. A computer program product comprising a computer readable storage medium having computer readable program code stored thereon, the computer readable program code comprising: computer readable program code configured to divide a tetragon comprise a detected digital representation of a document within the digital image into a plurality of sections, each section comprise a plurality of pixels;computer readable program code configured to determine a distribution of brightness values of each section;computer readable program code configured to determine a brightness value range of each section;computer readable program code configured to determine a variability of brightness values of each section;computer readable program code configured to determine whether each section is oversaturated;computer readable program code configured to determine whether each section is undersaturated;computer readable program code configured to determine a number of oversaturated sections;computer readable program code configured to determine a number of undersaturated sections;computer readable program code configured to determine that the digital image is oversaturated upon determine that a ratio of the number of oversaturated sections to a total number of sections exceeds an oversaturation threshold;computer readable program code configured to determine that the digital image is undersaturated upon determine that a ratio of the number of undersaturated sections to the total number of sections exceeds an undersaturation threshold; andcomputer readable program code configured to determine that the illumination problem exists in the digital image upon determine that the digital image is either undersaturated or oversaturated.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (253)
Kawasaki, Somei; Goden, Tatsuhito, Active matrix type display apparatus and driving method thereof.
Nakatsuka Kimihiro,JPX, Apparatus for determining image processing parameter, method of the same, and computer program product for realizing the method.
Barrett Terence W. (Vienna VA), Automata networks and methods for obtaining optimized dynamically reconfigurable computational architectures and control.
Sang ; Jr. Henry W. (Cupertio CA) Tahn Whei-Tsu H. (Sunnyvale CA) Zhang Xiao B. (Foster City CA), Automated method for creating templates in a forms recognition and processing system.
McElroy, John F.; Chorvat, Robert J., Cannabinoid receptor antagonists/inverse agonists useful for treating metabolic disorders, including obesity and diabetes.
Nishimura Kazuyuki (Ichikawa JPX) Sato Shinichi (Yokohama JPX), Color picture processing apparatus for reproducing a color picture having a smoothly changed gradation.
Suzuki,Masahiro; Tamune,Michihiro; Chen,Zhe Hong; Juen,Masahiro, Digital camera, storage medium for image signal processing, carrier wave and electronic camera.
Rowe Edward R. ; Priyadarshan Eswar ; Anderson Kenneth S. ; Al-Shamma Nabeel A. ; Taft Edward A. ; McQuarrie Elizabeth M. ; Cohn Richard, Displaying electronic documents with substitute fonts.
Nagatsuka,Tetsuro; Miyachi,Tatsuo; Shimada,Atsuo; Takeya,Kazutoshi; Kemmochi,Eiji; Nakajima,Akiko; Yamasaki,Makoto; Fujita,Katsuhiko, Document classification system and method for classifying a document according to contents of the document.
Borrey Roland G. (19251 Canyon Dr. Villa Park CA 92667) Borrey Daniel G. (19251 Canyon Dr. Villa Park CA 92667), Document identification by characteristics matching.
Clark ; Jr. Louis George (St. Charles MO) Gummow ; Jr. Donald Romaine (O\Fallon MO) Vanacht Marc (St. Louis MO), Hand-held GUI PDA with GPS/DGPS receiver for collecting agronomic and GPS position data.
LeBrun Thomas Q. (Dallas TX) Cage Kerry (Carrollton TX) Arnold Dennis D. (Carrollton TX), Image based document processing and information management system and apparatus.
Naofumi Yamamoto JP; Haruko Kawakami JP; Gururaj Rao JP, Image processing apparatus for discriminating image field of original document plural times and method therefor.
Appelt, Douglas E.; Arnold, James Frederick; Bear, John S.; Hobbs, Jerry Robert; Israel, David J.; Kameyama, Megumi; Martin, David L.; Myers, Karen Louise; Ravichandran, Gopalan; Stickel, Mark Edward, Information retrieval by natural language querying.
Walnut David Francis ; Berenstein Carlos Alberto ; Liu K. J. Ray ; Rashid-Farrokhi Farrokh, Method and apparatus for processing data from a tomographic imaging system.
Withers,William Douglas, Method and apparatus for recognizing a digitized form, extracting information from a filled-in form, and generating a corrected filled-in form.
Guberman Shelja A. (Moscow RUX) Lossev Ilia (Moscow RUX) Pashintsev Alexander V. (Moscow RUX), Method and apparatus for recognizing cursive writing from sequential input information.
Guberman Shelja A. (Moscow RUX) Lossev Ilia (Moscow RUX) Pashintsev Alexander V. (Moscow RUX), Method and apparatus for recognizing cursive writing from sequential input information.
Polyakov Vladislav G. (Moscow RUX) Ryleev Mikhail A. (Moscow RUX), Method and apparatus for representing image data using polynomial approximation method and iterative transformation-repa.
Green, Stephen J.; Lamere, Paul B.; Alexander, Jeffrey L.; Haberl, Karl R., Method and apparatus for searching and resource discovery in a distributed enterprise system.
Winkelman Kurt-Helfried (Kiel DEX), Method and apparatus for the automatic analysis of density range, color cast, and gradation of image originals on the Ba.
Berman, Arie; Vlahos, Paul; Dadourian, Arpag, Method and apparatus for the automatic generation of subject to background transition area boundary lines and subject shadow retention.
Verstraelen,Boudewijn Joseph Angelus; Verstraelen,Sebastiaan Paul, Method and apparatus for visualization of biological structures with use of 3D position information from segmentation results.
Tischler, Karl M., Method arrangement and computer software for the printing of a separator sheet by means of an electrophotographic printer or copier.
Kurosu Yasuo (Yokosuka JPX) Yokoyama Yoshihiro (Yokohama JPX) Nishikawa Kenichi (Yokohama JPX) Masuzaki Hidefumi (Hadano JPX) Fujinawa Masaaki (Tokyo JPX), Method for determining the amount of skew of image, method for correcting the same, and image data processing system.
Henderson Todd R. ; Spaulding Kevin E. ; Couwenhoven Douglas W., Method for segmenting a digital image into a foreground region and a key color region.
Kohchi Tsukasa JP, Method of and system for extracting predetermined elements from input document based upon model which is adaptively modified according to variable amount in the input document.
Beaulieu Dennis N. (Churchville NY) Compton John T. (LeRoy NY) Wojtanik Eugene R. (Plano TX), Method of calibration of image scanner signal processing circuits.
Dumais Susan T. ; Heckerman David ; Horvitz Eric ; Platt John Carlton ; Sahami Mehran, Methods and apparatus for classifying text and for building a text classifier.
Cheong, Cheol Ho; Han, Tack Don; Kim, Jong Young; Kim, Eui Jae; Jeong, Seong Hun; Kim, Jae Yun; Choi, Han Yeong, Mixed code, and method and apparatus for generating the same.
Michimoto Yasuyuki,JPX ; Onda Katsumasa,JPX ; Nishizawa Masato,JPX, Object detecting apparatus in which the position of a planar object is estimated by using hough transform.
Ellis, Stephen M.; Kennedy, Michael J.; Kurani, Ashish Bhoopen; Lowry, Melissa; Meyyappan, Uma; Sahni, Bipin; Stroke, Nikolai, System and method for a mobile wallet.
Woolf,Susan D.; Baird,Andrew; Jiang,Sheng; Beezer,John L.; Rubin,Darryl E., System and method for annotating an electronic document independently of its content.
Vazquez, Nicolas; Kodosky, Jeffrey L.; Kudukoli, Ram; Schultz, Kevin L.; Nair, Dinesh; Caltagirone, Christophe, System and method for automatically generating a graphical program to perform an image processing algorithm.
Emerson,Geoffrey A.; Moon,Rodney G.; Rector,Gerald C.; Stokes,Raymond F.; Sutton,Andrew H., System and method of sorting document images based on image quality.
Heidenreich,James R.; Higgins,Linda S., System and method to customize the facilitation of development of user thinking about and documenting of an arbitrary problem.
Sampath, Meera; Nichols, Stephen J.; Richenderfer, Elizabeth A., Systems and methods for automated image quality based diagnostics and remediation of document processing systems.
Ferlitsch,Andrew Rodney; DeVore,Darwin Alan, Systems and methods for manipulating electronic information using a three-dimensional iconic representation.
Roach, John J.; Nepomniachtchi, Grisha; Couch, Robert; Avergun, Mikhail, Systems and methods for obtaining financial offers using mobile image capture.
Gorski, Nikolai D.; Semenov, Andrey V.; Anisimov, Valery; Maksimov, Sergey K.; Sashov, Sergey N., Systems and methods for recognizing information in objects using a mobile device.
Borrey, Roland G.; Schmidtler, Mauritius A. R.; Taylor, Robert A.; Fechter, Joel S.; Asuri, Hari S., Systems and methods of accessing random access cache for rescanning.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods and computer program products for determining document validity.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods and computer program products for determining document validity.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods, and computer program products for determining document validity.
Ma, Jiyong; Thompson, Stephen Michael; Amtrup, Jan W., Content-based detection and three dimensional geometric reconstruction of objects in image and video data.
Macciola, Anthony; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher; Amtrup, Jan W., Determining distance between an object and a capture device based on captured image data.
Thrasher, Christopher W.; Shustorovich, Alexander; Thompson, Stephen Michael; Amtrup, Jan W.; Macciola, Anthony, Iterative recognition-guided thresholding and data extraction.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a broadcast radio service offer from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a broadcast radio service offer from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a location of a vehicle service center from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a location of a vehicle service center from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving vehicle information from an image and posting the vehicle information to a website.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving vehicle information from an image and posting the vehicle information to a website.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for recovering a vehicle identification number from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for recovering a vehicle identification number from an image.
Shustorovich, Alexander; Thrasher, Christopher W.; Ma, Jiyong; Macciola, Anthony; Amtrup, Jan W., Mobile document detection and orientation based on reference object characteristics.
Wilbert, Anthony Russell; Chung, David Ching-Chien; Wach, Hans Brandon; Rauker, Goran Matko; White, Solomon John, System and method for electronic processing of vehicle transactions based on image detection of vehicle license plate.
Amtrup, Jan W.; Macciola, Anthony; Thompson, Steve; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for classifying objects in digital images captured using mobile devices.
Amtrup, Jan W.; Macciola, Anthony; Thompson, Steve; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for classifying objects in digital images captured using mobile devices.
Macciola, Anthony; Amtrup, Jan W.; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher W.; Thompson, Stephen Michael, Systems and methods for classifying objects in digital images captured using mobile devices.
Amtrup, Jan Willers; Macciola, Anthony; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for mobile image capture and processing.
Macciola, Anthony; Amtrup, Jan Willers; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for mobile image capture and processing.
Thrasher, Christopher W.; Shustorovich, Alexander; Thompson, Stephen Michael; Amtrup, Jan W.; Macciola, Anthony; Borrey, Roland G.; Schmidtler, Mauritius A. R.; Taylor, Robert A.; Fechter, Joel S.; Asuri, Hari S., Systems and methods of processing scanned data.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.