Face tracking for controlling imaging parameters
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06K-009/34
출원번호
US-0814245
(2010-06-11)
등록번호
US-8385610
(2013-02-26)
발명자
/ 주소
Corcoran, Peter
Steinberg, Eran
Bigioi, Petronel
출원인 / 주소
DigitalOptics Corporation Europe Limited
인용정보
피인용 횟수 :
13인용 특허 :
247
초록▼
A method of tracking faces in an image stream with a digital image acquisition device includes receiving images from an image stream including faces, calculating corresponding integral images, and applying different subsets of face detection rectangles to the integral images to provide sets of candi
A method of tracking faces in an image stream with a digital image acquisition device includes receiving images from an image stream including faces, calculating corresponding integral images, and applying different subsets of face detection rectangles to the integral images to provide sets of candidate regions. The different subsets include candidate face regions of different sizes and/or locations within the images. The different candidate face regions from different images of the image stream are each tracked.
대표청구항▼
1. A face detection and recognition method, comprising: acquiring an image received from an image stream including one or more face regions;calculating an integral image for at least a portion of the image or a sub-sampled version of at least a portion of the image, or both;applying face detection t
1. A face detection and recognition method, comprising: acquiring an image received from an image stream including one or more face regions;calculating an integral image for at least a portion of the image or a sub-sampled version of at least a portion of the image, or both;applying face detection to at least a portion of the integral image to provide a set of one or more candidate face regions;using a database, including applying face recognition to one or more candidate face regions and providing an identifier for a recognized face;storing the identifier for the recognized face in association with at least one image or portion thereof that include the recognized face from the image stream; andadjusting white balance, color balance, focus, or exposure, or combinations thereof, for the recognized face. 2. The method of claim 1, further comprising applying face tracking to detect the recognized face from another image of the image stream. 3. The method of claim 1, wherein the database includes an identifier and one or more associated parameters for each of a number of one or more faces to be recognized. 4. The method of claim 1, wherein the applying face recognition is performed selectively, and the method further comprises selecting one or more candidate face regions having a frontal alignment for face recognition or including two eye regions and a mouth region within a given area of the candidate face region, or both. 5. The method of claim 1, further comprising providing a level of confidence for each candidate face region based on the face detection, and wherein a candidate face region is designated with a first level of confidence as a face region, and wherein face recognition is applied to candidate face regions having a second confidence level higher than the first level of confidence. 6. The method of claim 1, further comprising applying an Active Appearance Model (AAM) to one or more candidate face regions, and applying face recognition to one or more candidate face regions having AAM parameters indicating the candidate face region has a degree of rotation within a pre-determined range. 7. The method of claim 1, further comprising applying chain classifiers to the image, wherein at least one of the classifiers includes a frontal classifier chain, and applying face recognition to one or more candidate face regions detected with the frontal classifier chain. 8. The method of claim 1, further comprising calculating an average luminance for each candidate face region, and applying face recognition to one or more candidate face regions having average luminance within a pre-determined range. 9. The method of claim 1, wherein the image received from the image stream comprises a relatively low resolution preview image. 10. The method of claim 1, further comprising determining a subsequent location or size, or both, for the same face in a subsequent preview image; and based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again. 11. A digital image acquisition device, comprising a lens, an image sensor, a processor, and a processor-readable memory having digital code embedded therein for programming the processor to perform a method of detecting and recognizing faces in digital images acquired by the device, wherein the method comprises: determining acquiring an image received from an image stream including one or more face regions;calculating an integral image for at least a portion of the image or a sub-sampled version of at least a portion of the image, or both;applying face detection to at least a portion of the integral image to provide a set of one or more candidate face regions;using a database, including applying face recognition to one or more candidate face regions and providing an identifier for a recognized face;storing the identifier for the recognized face in association with at least one image or portion thereof that include the recognized face from the image stream; andadjusting white balance, color balance, focus, or exposure, or combinations thereof, for the recognized face. 12. The device of claim 11, wherein the method further comprises applying face tracking to detect the recognized face from another image of the image stream. 13. The device of claim 11, wherein the database includes an identifier and one or more associated parameters for each of a number of one or more faces to be recognized. 14. The device of claim 11, wherein the applying face recognition is performed selectively, and the method further comprises selecting one or more candidate face regions having a frontal alignment for face recognition or including two eye regions and a mouth region within a given area of the candidate face region, or both. 15. The device of claim 11, further comprising providing a level of confidence for each candidate face region based on the face detection, and wherein a candidate face region is designated with a first level of confidence as a face region, and wherein face recognition is applied to candidate face regions having a second confidence level higher than the first level of confidence. 16. The device of claim 11, further comprising applying an Active Appearance Model (AAM) to one or more candidate face regions, and applying face recognition to one or more candidate face regions having AAM parameters indicating the candidate face region has a degree of rotation within a pre-determined range. 17. The device of claim 11, further comprising applying chain classifiers to the image, wherein at least one of the classifiers includes a frontal classifier chain, and applying face recognition to one or more candidate face regions detected with the frontal classifier chain. 18. The device of claim 11, further comprising calculating an average luminance for each candidate face region, and applying face recognition to one or more candidate face regions having average luminance within a pre-determined range. 19. The device of claim 11, wherein the image received from the image stream comprises a relatively low resolution preview image. 20. The device of claim 11, further comprising determining a subsequent location or size, or both, for the same face in a subsequent preview image; and based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again. 21. One or more non-transitory processor-readable storage media having code embedded therein for programming a processor to perform a method of detecting and recognizing faces in digital images, wherein the method comprises: determining acquiring an image received from an image stream including one or more face regions;calculating an integral image for at least a portion of the image or a sub-sampled version of at least a portion of the image, or both;applying face detection to at least a portion of the integral image to provide a set of one or more candidate face regions;using a database, including applying face recognition to one or more candidate face regions and providing an identifier for a recognized face;storing the identifier for the recognized face in association with at least one image or portion thereof that include the recognized face from the image stream; andadjusting white balance, color balance, focus, or exposure, or combinations thereof, for the recognized face. 22. The one or more processor-readable storage media of claim 21, wherein the method further comprises applying face tracking to detect the recognized face from another image of the image stream. 23. The one or more processor-readable storage media of claim 21, wherein the database includes an identifier and one or more associated parameters for each of a number of one or more faces to be recognized. 24. The one or more processor-readable storage media of claim 21, wherein the applying face recognition is performed selectively, and the method further comprises selecting one or more candidate face regions having a frontal alignment for face recognition or including two eye regions and a mouth region within a given area of the candidate face region, or both. 25. The one or more processor-readable storage media of claim 21, further comprising providing a level of confidence for each candidate face region based on the face detection, and wherein a candidate face region is designated with a first level of confidence as a face region, and wherein face recognition is applied to candidate face regions having a second confidence level higher than the first level of confidence. 26. The one or more processor-readable storage media of claim 21, further comprising applying an Active Appearance Model (AAM) to one or more candidate face regions, and applying face recognition to one or more candidate face regions having AAM parameters indicating the candidate face region has a degree of rotation within a pre-determined range. 27. The one or more processor-readable storage media of claim 21, further comprising applying chain classifiers to the image, wherein at least one of the classifiers includes a frontal classifier chain, and applying face recognition to one or more candidate face regions detected with the frontal classifier chain. 28. The one or more processor-readable storage media of claim 21, further comprising calculating an average luminance for each candidate face region, and applying face recognition to one or more candidate face regions having average luminance within a pre-determined range. 29. The one or more processor-readable storage media of claim 21, wherein the image received from the image stream comprises a relatively low resolution preview image. 30. The one or more processor-readable storage media of claim 21, further comprising determining a subsequent location or size, or both, for the same face in a subsequent preview image; and based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (247)
Suzuki Shinichi (Tokyo JPX) Yasukawa Seiichi (Kawasaki JPX) Sato Toshihiro (Yokohama JPX) Narisawa Tsutomu (Saitama JPX), A photo taking apparatus capable of making a photograph with flash by a flash device.
White,Timothy J.; Blanco,Felix; Gerard,Michael J.; Leem,Yojin; Kurtenbach,Thomas J.; Christoffel,Douglas W.; Delong,Kevin R.; Smith,Craig M., Apparatus and method for processing digital images having eye color defects.
Hutcheson Timothy L. (Los Gatos CA) Or Wilson (Santa Clara CA) Narayanan Venkatesh (Fremont CA) Mohan Subramaniam (Sunnyvale CA) Wohlmut Peter G. (Saratoga CA) Srinivasan Ramanujam (Sunnyvale CA) Hun, Apparatus for generating a feature matrix based on normalized out-class and in-class variation matrices.
Benati Paul J. (Webster NY) Gray Robert T. (Rochester NY) Cosgrove Patrick A. (Honeoye Falls NY), Automated detection and correction of eye color defects due to flash illumination.
Eleftheriadis Alexandros ; Jacquin Arnaud Eric, Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video.
Harshaw Robert C. (Dallas TX) Burkey Ronald S. (Dallas TX) Doell James T. (Dallas TX) Keith Dennis G. (Dallas TX), Computerized checklist with predetermined sequences of sublists which automatically returns to skipped checklists.
Nesterov, Victor Anatol'evich; Khvatov, Vladimir Alezandrovich; Lalyko, Leonid Borisovich; Zaklika, Kryzstof Antoni, Correction of “red-eye” effects in images.
Matsuo, Hideaki; Imagawa, Kazuyuki; Takata, Yuji; Baba, Naruatsu; Ejima, Toshiaki, Device and method for face image extraction, and recording medium having recorded program for the method.
Buhr John D. ; Goodwin Robert M. ; Koeng Frederick R. ; Rivera Jose E., Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing.
Peter Fellegara ; Richard W. Lourette ; Michael E. Miller ; Linda M. Antos ; Robert H. Hibbard, Electronic camera with quick review of last captured image.
Parulski Kenneth A. (Rochester NY) Napoli Thomas A. (Rochester NY) Lewis David M. (Waterport NY), Electronic still camera for capturing and categorizing images.
Kuchta Daniel W. (Brockport NY) Sucy Peter J. (Hamlin NY), Electronic still camera providing multi-format storage of full and reduced resolution images.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Prasad K. Venkatesh (Cupertino CA) Stork David G. (Stanford CA), Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system.
Hanna, Keith James; Burt, Peter J.; Peleg, Shmuel; Dixon, Douglas F.; Mishra, Deepam; Wixson, Lambert E.; Mandlebaum, Robert; Coyle, Peter; Herman, Joshua R., Fully automated iris recognition system utilizing wide and narrow fields of view.
Poggio Tomaso ; Beymer David ; Jones Michael ; Vetter Thomas,DEX, Image compression by pointwise prototype correspondence using shape and texture information.
Lu Daozheng (Buffalo Grove IL) Kiewit David A. (Palm Harbor FL) Zhang Jia (Mundelein IL), Market research method and system for collecting retail store and shopper market research data.
Brogliatti, Barbara Spencer; Grakal, Christopher; Janney, Lisa A.; O'Neil, Marisa B.; Smith, Thomas G., Method and apparatus for archiving in and retrieving images from a digital image library.
Anderson, Eric C.; Bernstein, John D.; Pavely, John F.; Alsing, Carl J., Method and apparatus for defining a panning and zooming path across a still image during movie creation.
Gorday, Robert Mark; Gorday, Paul Edward; Eaton, Eric Thomas; Sibecas, Salvador, Method and apparatus for limiting storage or transmission of visual information.
Bedell Jeffrey L. (Arlington MA) Cockroft Gregory (Santa Clara CA) Peters Eric C. (Carlisle MA) Warner William J. (Weston MA), Method and apparatus for manipulating digital video data.
Fujio Noguchi ; Kazuhiko Akaike JP; Setsuko Watanabe Blaszkowski ; Noriko Kotabe GB; Takashi Otani JP; Tadashi Kajiwara, Method and apparatus for providing favorite station and programming information in a multiple station broadcast system.
Tal Peter (53 Driftwood Dr. Port Washington NY 11050), Method and apparatus for uniquely identifying individuals by particular physical characteristics and security system uti.
Zanzucchi,Peter John; Moroney, III,Richard Morgan; Aceti,John Gregory; Pletcher,Timothy Allen; Burstyn,Herschel Clement, Method and imager for detecting the location of objects.
Eckes,Christian; Kefalea,Efthimia; Von Der Malsburg,Chrstoph; P철tzsch,Michael; Rinne,Michael; Triesch,Jochen; Vorbr체ggen,Jan C., Method for recognizing objects in digitized images.
Steinberg,Eran; Prilutsky,Yury; Corcoran,Peter; Bigioi,Petronel, Method of improving orientation and color balance of digital images using face detection information.
Brunelli Roberto,ITX ; Mich Ornella,ITX, Method of storing and retrieving images of people, for example, in photographic archives and for the construction of id.
Ogrinc Michael A. (San Francisco CA) Card Robert A. (Palo Alto CA) Burns Chris R. (Mountain View CA) Clarke Charles P. (Los Altos CA) Collier Ronda L. (Scotts Valley CA) Collins Kevin M. (San Mateo C, Real time video image processing system.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Bigioi,Petronel, Real-time face tracking in a digital image acquisition device.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Biglol,Petronel, Real-time face tracking in a digital image acquisition device.
Ianculescu,Mihai; Bigioi,Petronel; Gangea,Mihnea; Petrescu,Stefan; Corcoran,Peter; Steinberg,Eran, Real-time face tracking in a digital image acquisition device.
Steinberg,Eran; Corcoran,Peter; Bigioi,Petronel; Pososin,Alexei; Drimbarean,Alexandru; Nanu,Florin; Petrescu,Stefan, Real-time face tracking in a digital image acquisition device.
Bortolussi Jay F. ; Cusack ; Jr. Francis J. ; Ehn Dennis C. ; Kuzeja Thomas M. ; Saulnier Michael S., Real-time facial recognition and verification system.
Bortolussi, Jay F.; Cusack, Jr., Francis J.; Ehn, Dennis C.; Kuzeja, Thomas M.; Saulnier, Michael S., Real-time facial recognition and verification system.
Okubo,Atsushi; Sabe,Kohtaro; Kawamoto,Kenta; Fukuchi,Masaki, Robot device and face identifying method, and image identifying device and image identifying method.
Maeda Yutaka (Kanagawa JPX) Kyoden Yasuhiro (Sagamihara JPX) Naruto Hirokazu (Higashiosaka JPX) Tanaka Yoshito (Sakai JPX) Shintani Dai (Sakai JPX) Nanba Katsuyuki (Osakasayama JPX), Still video camera having a printer capable of printing a photographed image in a plurality of printing modes.
Mashimo Yukio (Tokyo JA) Sakurada Nobuaki (Kanagawa JA) Ito Tadashi (Kanagawa JA) Ito Fumio (Kanagawa JA) Shinoda Nobuhiko (Tokyo JA), System for exposure measurement and/or focus detection by means of image senser.
Mashimo Yukio (Tokyo JPX) Sakurada Nobuaki (Kanagawa JPX) Ito Tadashi (Kanagawa JPX) Ito Fumio (Kanagawa JPX) Shinoda Nobuhiko (Tokyo JPX), System for exposure measurement and/or focus detection by means of image sensor.
Freeman William T. ; Leventon Michael E., System for reconstructing the 3-dimensional motions of a human figure from a monocularly-viewed image sequence.
Kuperstein Michael ; Kottas James A., System, method and application for the recognition, verification and similarity ranking of facial or other object patterns.
Wheeler Richard B. (Webster NY), Technique suited for use in multi-zone autofocusing cameras for improving image quality for non-standard display sizes a.
Kojima Kazuaki (Nagaokakyo JPX) Kuno Tetsuya (Nagaokakyo JPX) Sugiura Hiroaki (Nagaokakyo JPX) Yamada Takeshi (Nagaokakyo JPX), Video signal processor for detecting flesh tones in am image.
Jain Ramesh ; Horowitz Bradley ; Fuller Charles E. ; Gupta Amarnath ; Bach Jeffrey R. ; Shu Chiao-fe, Visual image database search engine which allows for different schema.
Kim, Kap Kee; Yoon, Seung Uk; Hwang, Bon Woo; Lim, Seong Jae; Jun, Hye Ryeong; Choi, Jin Sung; Koo, Bon Ki, Method and apparatus for reconstructing 3D face with stereo camera.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.