Image capture device with contemporaneous image correction mechanism
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/228
H04N-005/225
G06T-005/00
G06K-009/00
G06K-009/32
H04N-005/232
H04N-005/235
H04N-005/272
H04N-005/345
H04N-005/347
H04N-005/77
H04N-009/804
G06K-009/46
G06K-009/48
G06T-003/40
G06T-011/60
H04N-005/907
출원번호
US-0523816
(2014-10-24)
등록번호
US-9767539
(2017-09-19)
발명자
/ 주소
Zamfir, Adrian
Bigioi, Petronel
Corcoran, Peter
Drimbarean, Alexandru
Steinberg, Eran
출원인 / 주소
FotoNation Limited
인용정보
피인용 횟수 :
2인용 특허 :
266
초록▼
A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial ove
A hand-held or otherwise portable or spatial or temporal performance-based image capture device includes one or more lenses, an aperture and a main sensor for capturing an original main image. A secondary sensor and optical system are for capturing a reference image that has temporal and spatial overlap with the original image. The device performs an image processing method including capturing the main image with the main sensor and the reference image with the secondary sensor, and utilizing information from the reference image to enhance the main image. The main and secondary sensors are contained together within a housing.
대표청구항▼
1. A computer-implemented method comprising: receiving a plurality of images of a same scene captured by a camera;wherein the plurality of images comprises a particular image of the same scene, a preview image of the same scene and a postview image of the same scene;wherein the preview image, from t
1. A computer-implemented method comprising: receiving a plurality of images of a same scene captured by a camera;wherein the plurality of images comprises a particular image of the same scene, a preview image of the same scene and a postview image of the same scene;wherein the preview image, from the plurality of images, is an image acquired by the camera just shortly before the particular image was acquired by the camera;wherein the postview image, from the plurality of images, is an image acquired by the camera just after the particular image was acquired by the camera;wherein each of the preview image and the postview image has a resolution different than a resolution of the particular image;wherein each of the preview image and the postview image depicts the same objects and subjects as those depicted in the particular image of the plurality of images;determining whether the particular image, of the plurality of images, comprises a particular region that includes a defective depiction of one or more eyes;in response to determining that the particular image comprises the particular region that includes the defective depiction of the one or more eyes: selecting, either the preview image or the postview image that comprises a certain region;wherein: the certain region includes a non-defective depiction of the one or more eyes; andthe certain region corresponds to the particular region in the particular image; andgenerating a combination image based, at least in part, on the particular image and the certain region by replacing the particular region in the particular image with the certain region;wherein the method is performed by one or more processors of a computing device configured as an optical system. 2. The method of claim 1, wherein one or more images of the plurality of images are obtained using one or more infra-red sensors. 3. The method of claim 1, wherein the determining whether the particular image comprises the particular region that includes the defective depiction of the one or more eyes comprises determining whether the particular image comprises a region that includes a depiction of a blinking-eye, and if so, determining a degree to which the blinking-eye is shut. 4. The method of claim 3, wherein the degree to which the blinking-eye is shut is determined based on analyzing the particular image and one or more images, of the plurality of images, acquired within a certain time interval before or after the particular image was acquired. 5. The method of claim 3, wherein the determining whether the particular region comprises the depiction of the blinking-eye comprises determining a degree of blurriness of one or more eye lids depicted in the particular region. 6. The method of claim 1, further comprising: determining whether any portion of a pupil, an iris, one or more eye lids, or an eye sclera is depicted in the particular region;performing a shape analysis of shapes identified in the particular region; performing a color analysis of pixels included in the particular region. 7. The method of claim 1, further comprising: applying a set of sub-filters to the particular image to determine whether any pixel grouping in the particular image is compatible with one or more known depictions of eye-defects;wherein the set of sub-filters comprise one or more of: geometric filters, additional region compactness filters, boundary continuity filters, or region size filters; andwherein the applying of the set of sub-filters to the particular image comprises determining one or more of: an eye shape, eyebrows, iris regions, or a red-eye region. 8. An interactive computing device comprising a processor and a display, wherein the processor is arranged to perform: receiving a plurality of images of a same scene captured by a camera;wherein the plurality of images comprises a particular image of the same scene, a preview image of the same scene and a postview image of the same scene;wherein the preview image, from the plurality of images, is an image acquired by the camera just shortly before the particular image was acquired by the camera;wherein the postview image, from the plurality of images, is an image acquired by the camera just after the particular image was acquired by the camera;wherein each of the preview image and the postview image has a resolution different than a resolution of the particular image;wherein each of the preview image and the postview image depicts the same objects and subjects as those depicted in the particular image of the plurality of images;determining whether the particular image, of the plurality of images, comprises a particular region that includes a defective depiction of one or more eyes;in response to determining that the particular image comprises the particular region that includes the defective depiction of the one or more eyes:selecting, either the preview image or the postview image that comprises a certain region;wherein: the certain region includes a non-defective depiction of the one or more eyes; andthe certain region corresponds to the particular region in the particular image; andgenerating a combination image based, at least in part, on the particular image and the certain region by replacing the particular region in the particular image with the certain region. 9. The interactive computing device of claim 8, wherein one or more images of the plurality of images are obtained using one or more infra-red sensors. 10. The interactive computing device of claim 8, wherein the determining whether the particular image comprises the particular region that includes the defective depiction of the one or more eyes comprises determining whether the particular image comprises a region that includes a depiction of a blinking-eye, and if so, determining a degree to which the blinking-eye is shut. 11. The interactive computing device of claim 10, wherein the degree to which the blinking-eye is shut is determined based on analyzing the particular image and one or more images, of the plurality of images, acquired within a certain time interval before or after the particular image was acquired. 12. The interactive computing device of claim 10, wherein the determining whether the particular region comprises the depiction of the blinking-eye comprises determining a degree of blurriness of one or more eye lids depicted in the particular region. 13. The interactive computing device of claim 8, wherein the processor is further arranged to perform: determining whether any portion of a pupil, an iris, one or more eye lids, or an eye sclera is depicted in the particular region;performing a shape analysis of shapes identified in the particular region; performing a color analysis of pixels included in the particular region. 14. The interactive computing device of claim 8, wherein the processor is further arranged to perform: applying a set of sub-filters to the particular image to determine whether any pixel grouping in the particular image is compatible with one or more known depictions of eye-defects;wherein the set of sub-filters comprise one or more of: geometric filters, additional region compactness filters, boundary continuity filters, or region size filters; andwherein the applying of the set of sub-filters to the particular image comprises determining one or more of: an eye shape, eyebrows, iris regions, or a red-eye region. 15. A non-transitory, computer-readable storage medium storing one or more executable instructions which, when executed by one or more processors of an interactive computing device, cause performance of: receiving a plurality of images of a same scene captured by a camera;wherein the plurality of images comprises a particular image of the same scene, a preview image of the same scene and a postview image of the same scene;wherein the preview image, from the plurality of images, is an image acquired by the camera just shortly before the particular image was acquired by the camera;wherein the postview image, from the plurality of images, is an image acquired by the camera just after the particular image was acquired by the camera;wherein each of the preview image and the postview image has a resolution different than a resolution of the particular image;wherein each of the preview image and the postview image depicts the same objects and subjects as those depicted in the particular image of the plurality of images;determining whether the particular image, of the plurality of images, comprises a particular region that includes a defective depiction of one or more eyes;in response to determining that the particular image comprises the particular region that includes the defective depiction of the one or more eyes:selecting either the preview image or the postview image that comprises a certain region;wherein: the certain region includes a non-defective depiction of the one or more eyes; andthe certain region corresponds to the particular region in the particular image; andgenerating a combination image based, at least in part, on the particular image and the certain region by replacing the particular region in the particular image with the certain region. 16. The non-transitory, computer-readable storage medium of claim 15, wherein one or more images of the plurality of images are obtained using one or more infra-red sensors. 17. The non-transitory, computer-readable storage medium of claim 15, comprising additional instructions which, when executed by the one or more processors, cause performance of: determining whether the particular image comprises a region that includes a depiction of a blinking-eye, and if so, determining a degree to which the blinking-eye is shut. 18. The non-transitory, computer-readable storage medium of claim 17, wherein the degree to which the blinking-eye is shut is determined based on analyzing the particular image and one or more images, of the plurality of images, acquired within a certain time interval before or after the particular image was acquired. 19. The non-transitory, computer-readable storage medium of claim 17, comprising additional instructions which, when executed by the one or more processors, cause performance of: determining a degree of blurriness of one or more eye lids depicted in the particular region. 20. The non-transitory, computer-readable storage medium of claim 15, storing additional instructions which, when executed by the one or more processors, cause performance of: determining whether any portion of a pupil, an iris, one or more eye lids, or an eye sclera is depicted in the particular region;performing a shape analysis of shapes identified in the particular region; performing a color analysis of pixels included in the particular region. 21. The non-transitory, computer-readable storage medium of claim 15, storing additional instructions which, when executed by the one or more processors, cause performance of: applying a set of sub-filters to the particular image to determine whether any pixel grouping in the particular image is compatible with one or more known depictions of eye-defects;wherein the set of sub-filters comprise one or more of: geometric filters, additional region compactness filters, boundary continuity filters, or region size filters; andwherein the applying of the set of sub-filters to the particular image comprises determining one or more of: an eye shape, eyebrows, iris regions, or a red-eye region.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (266)
Suzuki Shinichi (Tokyo JPX) Yasukawa Seiichi (Kawasaki JPX) Sato Toshihiro (Yokohama JPX) Narisawa Tsutomu (Saitama JPX), A photo taking apparatus capable of making a photograph with flash by a flash device.
Hayashi, Asao; Oinoue, Kenichi; Aoki, Masahiro; Ida, Masatoshi, Apparatus and method for detecting focus condition of imaging optical system employing both sharpness detection and lateral shift detection.
White,Timothy J.; Blanco,Felix; Gerard,Michael J.; Leem,Yojin; Kurtenbach,Thomas J.; Christoffel,Douglas W.; Delong,Kevin R.; Smith,Craig M., Apparatus and method for processing digital images having eye color defects.
Hutcheson Timothy L. (Los Gatos CA) Or Wilson (Santa Clara CA) Narayanan Venkatesh (Fremont CA) Mohan Subramaniam (Sunnyvale CA) Wohlmut Peter G. (Saratoga CA) Srinivasan Ramanujam (Sunnyvale CA) Hun, Apparatus for generating a feature matrix based on normalized out-class and in-class variation matrices.
Benati Paul J. (Webster NY) Gray Robert T. (Rochester NY) Cosgrove Patrick A. (Honeoye Falls NY), Automated detection and correction of eye color defects due to flash illumination.
Eleftheriadis Alexandros ; Jacquin Arnaud Eric, Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video.
Harshaw Robert C. (Dallas TX) Burkey Ronald S. (Dallas TX) Doell James T. (Dallas TX) Keith Dennis G. (Dallas TX), Computerized checklist with predetermined sequences of sublists which automatically returns to skipped checklists.
Nesterov, Victor Anatol'evich; Khvatov, Vladimir Alezandrovich; Lalyko, Leonid Borisovich; Zaklika, Kryzstof Antoni, Correction of “red-eye” effects in images.
Matsuo, Hideaki; Imagawa, Kazuyuki; Takata, Yuji; Baba, Naruatsu; Ejima, Toshiaki, Device and method for face image extraction, and recording medium having recorded program for the method.
Buhr John D. ; Goodwin Robert M. ; Koeng Frederick R. ; Rivera Jose E., Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing.
Peter Fellegara ; Richard W. Lourette ; Michael E. Miller ; Linda M. Antos ; Robert H. Hibbard, Electronic camera with quick review of last captured image.
Parulski Kenneth A. (Rochester NY) Napoli Thomas A. (Rochester NY) Lewis David M. (Waterport NY), Electronic still camera for capturing and categorizing images.
Kuchta Daniel W. (Brockport NY) Sucy Peter J. (Hamlin NY), Electronic still camera providing multi-format storage of full and reduced resolution images.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Prasad K. Venkatesh (Cupertino CA) Stork David G. (Stanford CA), Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system.
Hanna, Keith James; Burt, Peter J.; Peleg, Shmuel; Dixon, Douglas F.; Mishra, Deepam; Wixson, Lambert E.; Mandlebaum, Robert; Coyle, Peter; Herman, Joshua R., Fully automated iris recognition system utilizing wide and narrow fields of view.
Poggio Tomaso ; Beymer David ; Jones Michael ; Vetter Thomas,DEX, Image compression by pointwise prototype correspondence using shape and texture information.
Lu Daozheng (Buffalo Grove IL) Kiewit David A. (Palm Harbor FL) Zhang Jia (Mundelein IL), Market research method and system for collecting retail store and shopper market research data.
Brogliatti, Barbara Spencer; Grakal, Christopher; Janney, Lisa A.; O'Neil, Marisa B.; Smith, Thomas G., Method and apparatus for archiving in and retrieving images from a digital image library.
Anderson, Eric C.; Bernstein, John D.; Pavely, John F.; Alsing, Carl J., Method and apparatus for defining a panning and zooming path across a still image during movie creation.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Bigioi, Petronel; Zamfir, Adrian; Nanu, Florin; Drimbarean, Alexandru, Method and apparatus for detection and correction of multiple image defects within digital images using preview or other reference images.
Gorday, Robert Mark; Gorday, Paul Edward; Eaton, Eric Thomas; Sibecas, Salvador, Method and apparatus for limiting storage or transmission of visual information.
Bedell Jeffrey L. (Arlington MA) Cockroft Gregory (Santa Clara CA) Peters Eric C. (Carlisle MA) Warner William J. (Weston MA), Method and apparatus for manipulating digital video data.
Fujio Noguchi ; Kazuhiko Akaike JP; Setsuko Watanabe Blaszkowski ; Noriko Kotabe GB; Takashi Otani JP; Tadashi Kajiwara, Method and apparatus for providing favorite station and programming information in a multiple station broadcast system.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Biglol, Petronel; Nanu, Florin, Method and apparatus for red-eye detection in an acquired digital image.
Steinberg,Eran; Corcoran,Peter; Prilutsky,Yury; Bigioi,Petronel; Nanu,Florin, Method and apparatus for red-eye detection in an acquired digital image based on image quality pre and post filtering.
Tal Peter (53 Driftwood Dr. Port Washington NY 11050), Method and apparatus for uniquely identifying individuals by particular physical characteristics and security system uti.
Zanzucchi,Peter John; Moroney, III,Richard Morgan; Aceti,John Gregory; Pletcher,Timothy Allen; Burstyn,Herschel Clement, Method and imager for detecting the location of objects.
Eckes,Christian; Kefalea,Efthimia; Von Der Malsburg,Chrstoph; P철tzsch,Michael; Rinne,Michael; Triesch,Jochen; Vorbr체ggen,Jan C., Method for recognizing objects in digitized images.
Steinberg,Eran; Prilutsky,Yury; Corcoran,Peter; Bigioi,Petronel, Method of improving orientation and color balance of digital images using face detection information.
Brunelli Roberto,ITX ; Mich Ornella,ITX, Method of storing and retrieving images of people, for example, in photographic archives and for the construction of id.
Ogrinc Michael A. (San Francisco CA) Card Robert A. (Palo Alto CA) Burns Chris R. (Mountain View CA) Clarke Charles P. (Los Altos CA) Collier Ronda L. (Scotts Valley CA) Collins Kevin M. (San Mateo C, Real time video image processing system.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Bigioi,Petronel, Real-time face tracking in a digital image acquisition device.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Biglol,Petronel, Real-time face tracking in a digital image acquisition device.
Ianculescu,Mihai; Bigioi,Petronel; Gangea,Mihnea; Petrescu,Stefan; Corcoran,Peter; Steinberg,Eran, Real-time face tracking in a digital image acquisition device.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Steinberg,Eran; Corcoran,Peter; Bigioi,Petronel; Pososin,Alexei; Drimbarean,Alexandru; Nanu,Florin; Petrescu,Stefan, Real-time face tracking in a digital image acquisition device.
Bortolussi Jay F. ; Cusack ; Jr. Francis J. ; Ehn Dennis C. ; Kuzeja Thomas M. ; Saulnier Michael S., Real-time facial recognition and verification system.
Bortolussi, Jay F.; Cusack, Jr., Francis J.; Ehn, Dennis C.; Kuzeja, Thomas M.; Saulnier, Michael S., Real-time facial recognition and verification system.
Okubo,Atsushi; Sabe,Kohtaro; Kawamoto,Kenta; Fukuchi,Masaki, Robot device and face identifying method, and image identifying device and image identifying method.
Maeda Yutaka (Kanagawa JPX) Kyoden Yasuhiro (Sagamihara JPX) Naruto Hirokazu (Higashiosaka JPX) Tanaka Yoshito (Sakai JPX) Shintani Dai (Sakai JPX) Nanba Katsuyuki (Osakasayama JPX), Still video camera having a printer capable of printing a photographed image in a plurality of printing modes.
Mashimo Yukio (Tokyo JA) Sakurada Nobuaki (Kanagawa JA) Ito Tadashi (Kanagawa JA) Ito Fumio (Kanagawa JA) Shinoda Nobuhiko (Tokyo JA), System for exposure measurement and/or focus detection by means of image senser.
Mashimo Yukio (Tokyo JPX) Sakurada Nobuaki (Kanagawa JPX) Ito Tadashi (Kanagawa JPX) Ito Fumio (Kanagawa JPX) Shinoda Nobuhiko (Tokyo JPX), System for exposure measurement and/or focus detection by means of image sensor.
Freeman William T. ; Leventon Michael E., System for reconstructing the 3-dimensional motions of a human figure from a monocularly-viewed image sequence.
Kuperstein Michael ; Kottas James A., System, method and application for the recognition, verification and similarity ranking of facial or other object patterns.
Wheeler Richard B. (Webster NY), Technique suited for use in multi-zone autofocusing cameras for improving image quality for non-standard display sizes a.
Kojima Kazuaki (Nagaokakyo JPX) Kuno Tetsuya (Nagaokakyo JPX) Sugiura Hiroaki (Nagaokakyo JPX) Yamada Takeshi (Nagaokakyo JPX), Video signal processor for detecting flesh tones in am image.
Jain Ramesh ; Horowitz Bradley ; Fuller Charles E. ; Gupta Amarnath ; Bach Jeffrey R. ; Shu Chiao-fe, Visual image database search engine which allows for different schema.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.