Systems and methods for detecting and classifying objects in video captured using mobile devices
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-001/04
H04N-001/00
G06K-009/18
G06K-009/20
G06K-009/62
H04N-005/232
출원번호
US-0473950
(2014-08-29)
등록번호
US-9253349
(2016-02-02)
발명자
/ 주소
Amtrup, Jan W.
Ma, Jiyong
Macciola, Anthony
출원인 / 주소
Kofax, Inc.
대리인 / 주소
Zilka-Kotab, PC
인용정보
피인용 횟수 :
43인용 특허 :
249
초록▼
A method includes capturing plural frames of video data using a mobile device. The frames are analyzed to determine whether any depict an object exhibiting one or more defining characteristics, and if so, whether those frame(s) depicting the object also satisfy one or more predetermined quality cont
A method includes capturing plural frames of video data using a mobile device. The frames are analyzed to determine whether any depict an object exhibiting one or more defining characteristics, and if so, whether those frame(s) depicting the object also satisfy one or more predetermined quality control criteria. If one or more of the frames depict the object and also satisfy the one or more predetermined quality control criteria, the method further includes automatically capturing an image of the object. Exemplary defining characteristics are specified for various types of object, particularly objects comprising documents. Related systems and computer program products are also disclosed. The presently disclosed techniques and systems represent translational developments across the fields of image processing and business process management. Improved analytical techniques enable processing of image captured using cameras rather than traditional scanner technology, and facilitate distribution, tracking and analysis of documents and information throughout business processes.
대표청구항▼
1. A method, comprising: capturing video data using a mobile device, the video data comprising a plurality of frames;determining whether one or more of the frames depict an object exhibiting one or more defining characteristics;determining whether one or more of the frame(s) determined to depict the
1. A method, comprising: capturing video data using a mobile device, the video data comprising a plurality of frames;determining whether one or more of the frames depict an object exhibiting one or more defining characteristics;determining whether one or more of the frame(s) determined to depict the object also satisfy one or more predetermined quality control criteria; andin response to determining one or more of the frames depict the object and also satisfy the one or more predetermined quality control criteria, automatically capturing an image of the object. 2. The method as recited in claim 1, further comprising initiating a business process in response to determining the one or more of the frames depict the object and also satisfy the one or more predetermined quality control criteria, wherein the business process relies at least in part on the automatically captured image. 3. The method as recited in claim 1, wherein the image is characterized by a resolution higher than a resolution of any of the plurality of frames. 4. The method as recited in claim 1, wherein the defining characteristics comprise one or more of: an object shape;an object contour;one or more object dimensions; andan object color profile. 5. The method as recited in claim 1, wherein determining whether one or more of the frames depict the object comprises performing optical character recognition (OCR). 6. The method as recited in claim 1, wherein the object is a document. 7. The method as recited in claim 6, wherein the defining characteristics comprise one or more of: textual information depicted on the document;a photograph depicted on the document;a barcode depicted on the document;a logo depicted on the document;an emblem depicted on the document;a seal depicted on the document; andan aspect ratio of the document. 8. The method as recited in claim 6, wherein the document corresponds to a loan application. 9. The method as recited in claim 8, wherein the defining characteristics comprise the document depicting one or more of: a customer name;a guarantor name;a customer address;a date;an account number;a loan number;a digital signature;a handwritten signature; anda photograph. 10. The method as recited in claim 6, wherein the document comprises one or more of: a receipt;an expense report;a credit card; anda check. 11. The method as recited in claim 10, wherein the defining characteristics comprise the document depicting one or more of: a credit card number;a name;an expense amount; andan order number. 12. The method as recited in claim 6, wherein the document comprises a medical record. 13. The method as recited in claim 6, wherein the document corresponds to an insurance claim. 14. The method as recited in claim 13, wherein the defining characteristics comprise the document depicting one or more of: a photograph of an automobile;a photograph of an accident report;a photograph of a proof of insurance document;a photograph of a driver's license;a photograph of a quote; anda signature. 15. The method as recited in claim 6, wherein the document corresponds to a delivery. 16. The method as recited in claim 15, wherein the defining characteristics comprise the document depicting one or more of: a signature;a proof of delivery;a package number;a photograph of a package; anda declaration of package contents. 17. The method as recited in claim 6, wherein the document corresponds to an educational program application. 18. The method as recited in claim 17, wherein the defining characteristics comprise the document depicting one or more of: an applicant name;a photograph of an applicant; anda student identification document. 19. A system, comprising a processor and logic executable by the processor, the logic being configured to cause the processor to: capture video data using a mobile device, the video data comprising a plurality of frames;determine whether one or more of the frames depict an object exhibiting one or more defining characteristics;determine whether one or more of the frame(s) determined to depict the object also satisfy one or more predetermined quality control criteria; andin response to determining one or more of the frames depict the object and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the object. 20. A computer program product, comprising a non-transitory computer readable storage medium having embodied therewith compute readable program code configured to cause a processor to: capture video data using a mobile device, the video data comprising a plurality of frames;determine whether one or more of the frames depict an object exhibiting one or more defining characteristics;determine whether one or more of the frame(s) determined to depict the object also satisfy one or more predetermined quality control criteria; andin response to determining one or more of the frames depict the object and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the object.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (249)
Kawasaki, Somei; Goden, Tatsuhito, Active matrix type display apparatus and driving method thereof.
Nakatsuka Kimihiro,JPX, Apparatus for determining image processing parameter, method of the same, and computer program product for realizing the method.
Barrett Terence W. (Vienna VA), Automata networks and methods for obtaining optimized dynamically reconfigurable computational architectures and control.
Sang ; Jr. Henry W. (Cupertio CA) Tahn Whei-Tsu H. (Sunnyvale CA) Zhang Xiao B. (Foster City CA), Automated method for creating templates in a forms recognition and processing system.
McElroy, John F.; Chorvat, Robert J., Cannabinoid receptor antagonists/inverse agonists useful for treating metabolic disorders, including obesity and diabetes.
Nishimura Kazuyuki (Ichikawa JPX) Sato Shinichi (Yokohama JPX), Color picture processing apparatus for reproducing a color picture having a smoothly changed gradation.
Suzuki,Masahiro; Tamune,Michihiro; Chen,Zhe Hong; Juen,Masahiro, Digital camera, storage medium for image signal processing, carrier wave and electronic camera.
Rowe Edward R. ; Priyadarshan Eswar ; Anderson Kenneth S. ; Al-Shamma Nabeel A. ; Taft Edward A. ; McQuarrie Elizabeth M. ; Cohn Richard, Displaying electronic documents with substitute fonts.
Nagatsuka,Tetsuro; Miyachi,Tatsuo; Shimada,Atsuo; Takeya,Kazutoshi; Kemmochi,Eiji; Nakajima,Akiko; Yamasaki,Makoto; Fujita,Katsuhiko, Document classification system and method for classifying a document according to contents of the document.
Borrey Roland G. (19251 Canyon Dr. Villa Park CA 92667) Borrey Daniel G. (19251 Canyon Dr. Villa Park CA 92667), Document identification by characteristics matching.
Clark ; Jr. Louis George (St. Charles MO) Gummow ; Jr. Donald Romaine (O\Fallon MO) Vanacht Marc (St. Louis MO), Hand-held GUI PDA with GPS/DGPS receiver for collecting agronomic and GPS position data.
LeBrun Thomas Q. (Dallas TX) Cage Kerry (Carrollton TX) Arnold Dennis D. (Carrollton TX), Image based document processing and information management system and apparatus.
Naofumi Yamamoto JP; Haruko Kawakami JP; Gururaj Rao JP, Image processing apparatus for discriminating image field of original document plural times and method therefor.
Appelt, Douglas E.; Arnold, James Frederick; Bear, John S.; Hobbs, Jerry Robert; Israel, David J.; Kameyama, Megumi; Martin, David L.; Myers, Karen Louise; Ravichandran, Gopalan; Stickel, Mark Edward, Information retrieval by natural language querying.
Walnut David Francis ; Berenstein Carlos Alberto ; Liu K. J. Ray ; Rashid-Farrokhi Farrokh, Method and apparatus for processing data from a tomographic imaging system.
Withers,William Douglas, Method and apparatus for recognizing a digitized form, extracting information from a filled-in form, and generating a corrected filled-in form.
Guberman Shelja A. (Moscow RUX) Lossev Ilia (Moscow RUX) Pashintsev Alexander V. (Moscow RUX), Method and apparatus for recognizing cursive writing from sequential input information.
Guberman Shelja A. (Moscow RUX) Lossev Ilia (Moscow RUX) Pashintsev Alexander V. (Moscow RUX), Method and apparatus for recognizing cursive writing from sequential input information.
Polyakov Vladislav G. (Moscow RUX) Ryleev Mikhail A. (Moscow RUX), Method and apparatus for representing image data using polynomial approximation method and iterative transformation-repa.
Green, Stephen J.; Lamere, Paul B.; Alexander, Jeffrey L.; Haberl, Karl R., Method and apparatus for searching and resource discovery in a distributed enterprise system.
Winkelman Kurt-Helfried (Kiel DEX), Method and apparatus for the automatic analysis of density range, color cast, and gradation of image originals on the Ba.
Berman, Arie; Vlahos, Paul; Dadourian, Arpag, Method and apparatus for the automatic generation of subject to background transition area boundary lines and subject shadow retention.
Verstraelen,Boudewijn Joseph Angelus; Verstraelen,Sebastiaan Paul, Method and apparatus for visualization of biological structures with use of 3D position information from segmentation results.
Tischler, Karl M., Method arrangement and computer software for the printing of a separator sheet by means of an electrophotographic printer or copier.
Kurosu Yasuo (Yokosuka JPX) Yokoyama Yoshihiro (Yokohama JPX) Nishikawa Kenichi (Yokohama JPX) Masuzaki Hidefumi (Hadano JPX) Fujinawa Masaaki (Tokyo JPX), Method for determining the amount of skew of image, method for correcting the same, and image data processing system.
Henderson Todd R. ; Spaulding Kevin E. ; Couwenhoven Douglas W., Method for segmenting a digital image into a foreground region and a key color region.
Kohchi Tsukasa JP, Method of and system for extracting predetermined elements from input document based upon model which is adaptively modified according to variable amount in the input document.
Beaulieu Dennis N. (Churchville NY) Compton John T. (LeRoy NY) Wojtanik Eugene R. (Plano TX), Method of calibration of image scanner signal processing circuits.
Dumais Susan T. ; Heckerman David ; Horvitz Eric ; Platt John Carlton ; Sahami Mehran, Methods and apparatus for classifying text and for building a text classifier.
Michimoto Yasuyuki,JPX ; Onda Katsumasa,JPX ; Nishizawa Masato,JPX, Object detecting apparatus in which the position of a planar object is estimated by using hough transform.
Ellis, Stephen M.; Kennedy, Michael J.; Kurani, Ashish Bhoopen; Lowry, Melissa; Meyyappan, Uma; Sahni, Bipin; Stroke, Nikolai, System and method for a mobile wallet.
Woolf,Susan D.; Baird,Andrew; Jiang,Sheng; Beezer,John L.; Rubin,Darryl E., System and method for annotating an electronic document independently of its content.
Vazquez, Nicolas; Kodosky, Jeffrey L.; Kudukoli, Ram; Schultz, Kevin L.; Nair, Dinesh; Caltagirone, Christophe, System and method for automatically generating a graphical program to perform an image processing algorithm.
Emerson,Geoffrey A.; Moon,Rodney G.; Rector,Gerald C.; Stokes,Raymond F.; Sutton,Andrew H., System and method of sorting document images based on image quality.
Heidenreich,James R.; Higgins,Linda S., System and method to customize the facilitation of development of user thinking about and documenting of an arbitrary problem.
Sampath, Meera; Nichols, Stephen J.; Richenderfer, Elizabeth A., Systems and methods for automated image quality based diagnostics and remediation of document processing systems.
Ferlitsch,Andrew Rodney; DeVore,Darwin Alan, Systems and methods for manipulating electronic information using a three-dimensional iconic representation.
Roach, John J.; Nepomniachtchi, Grisha; Couch, Robert; Avergun, Mikhail, Systems and methods for obtaining financial offers using mobile image capture.
Gorski, Nikolai D.; Semenov, Andrey V.; Anisimov, Valery; Maksimov, Sergey K.; Sashov, Sergey N., Systems and methods for recognizing information in objects using a mobile device.
Borrey, Roland G.; Schmidtler, Mauritius A. R.; Taylor, Robert A.; Fechter, Joel S.; Asuri, Hari S., Systems and methods of accessing random access cache for rescanning.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods and computer program products for determining document validity.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods and computer program products for determining document validity.
Schmidtler, Mauritius A. R.; Borrey, Roland G.; Amtrup, Jan W.; Thompson, Stephen Michael, Systems, methods, and computer program products for determining document validity.
Ma, Jiyong; Thompson, Stephen Michael; Amtrup, Jan W., Content-based detection and three dimensional geometric reconstruction of objects in image and video data.
Macciola, Anthony; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher; Amtrup, Jan W., Determining distance between an object and a capture device based on captured image data.
Thrasher, Christopher W.; Shustorovich, Alexander; Thompson, Stephen Michael; Amtrup, Jan W.; Macciola, Anthony, Iterative recognition-guided thresholding and data extraction.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a broadcast radio service offer from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a broadcast radio service offer from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a location of a vehicle service center from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving a location of a vehicle service center from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving vehicle information from an image and posting the vehicle information to a website.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for receiving vehicle information from an image and posting the vehicle information to a website.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for recovering a vehicle identification number from an image.
Wilbert, Anthony Russell; Wach, Hans Brandon; Chung, David Ching-Chien, Method and apparatus for recovering a vehicle identification number from an image.
Shustorovich, Alexander; Thrasher, Christopher W.; Ma, Jiyong; Macciola, Anthony; Amtrup, Jan W., Mobile document detection and orientation based on reference object characteristics.
Wilbert, Anthony Russell; Chung, David Ching-Chien; Wach, Hans Brandon; Rauker, Goran Matko; White, Solomon John, System and method for electronic processing of vehicle transactions based on image detection of vehicle license plate.
Amtrup, Jan W.; Macciola, Anthony; Thompson, Steve; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for classifying objects in digital images captured using mobile devices.
Amtrup, Jan W.; Macciola, Anthony; Thompson, Steve; Ma, Jiyong; Shustorovich, Alexander; Thrasher, Christopher W., Systems and methods for classifying objects in digital images captured using mobile devices.
Thrasher, Christopher W.; Shustorovich, Alexander; Thompson, Stephen Michael; Amtrup, Jan W.; Macciola, Anthony; Borrey, Roland G.; Schmidtler, Mauritius A. R.; Taylor, Robert A.; Fechter, Joel S.; Asuri, Hari S., Systems and methods of processing scanned data.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.