Real-time face tracking with reference images
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06K-009/36
출원번호
UP-0141042
(2008-06-17)
등록번호
US-7620218
(2009-11-27)
발명자
/ 주소
Steinberg, Eran
Bigioi, Petronel
Corcoran, Peter
Pososin, Alexei
Drimbarean, Alexandru
Nanu, Florin
Petrescu, Stefan
출원인 / 주소
FotoNation Ireland Limited
대리인 / 주소
Smith, Andrew V.
인용정보
피인용 횟수 :
65인용 특허 :
232
초록▼
A method of tracking a face in a reference image stream using a digital image acquisition device includes acquiring a full resolution main image and an image stream of relatively low resolution reference images each including one or more face regions. One or more face regions are identified within t
A method of tracking a face in a reference image stream using a digital image acquisition device includes acquiring a full resolution main image and an image stream of relatively low resolution reference images each including one or more face regions. One or more face regions are identified within two or more of the reference images. A relative movement is determined between the two or more reference images. A size and location are determined of the one or more face regions within each of the two or more reference images. Concentrated face detection is applied to at least a portion of the full resolution main image in a predicted location for candidate face regions having a predicted size as a function of the determined relative movement and the size and location of the one or more face regions within the reference images, to provide a set of candidate face regions for the main image.
대표청구항▼
The invention claimed is: 1. A method of tracking a face in a reference image stream using a digital image acquisition device, comprising: a. acquiring a full resolution main image and an image stream of relatively low resolution reference images each including one or more face regions; b. identify
The invention claimed is: 1. A method of tracking a face in a reference image stream using a digital image acquisition device, comprising: a. acquiring a full resolution main image and an image stream of relatively low resolution reference images each including one or more face regions; b. identifying one or more face regions within two or more of said reference images; c. determining a relative movement between said two or more reference images; d. determining a size and location of said one or more face regions within each of said two or more reference images; e. applying concentrated face detection to at least a portion of said full resolution main image in a predicted location for candidate face regions having a predicted size as a function of the determined relative movement and the size and location of said one or more face regions within said reference images, to provide a set of candidate face regions for said main image; f. applying image processing to said main image based on said information regarding said set of candidate face regions to generate a processed version of the main image; and g. displaying, storing, or transmitting the processed version of said main image, or combinations thereof. 2. A method as claimed in claim 1 wherein said indication of relative movement comprises an amount and direction of movement. 3. A method as claimed in claim 1 wherein said adjusted face detection comprises: prior to applying face detection, shifting said associated set of candidate face regions as a function of said movement. 4. A method as claimed in claim 3, further comprising shifting said face regions as a function of their size and as a function of said movement. 5. A method as claimed in claim 1 wherein said adjusted face detection comprises: applying face detection to a region of a next acquired image comprising candidate regions corresponding to the previously acquired image expanded as a function of said movement. 6. A method as claimed in claim 5, wherein said candidate regions of said next acquired image are expanded as a function of their original size and as a function of said movement. 7. A method as claimed in claim 1, further comprising selectively apply face recognition using a database to at least some of said candidate face regions to provide an identifier for each of one or more faces recognized in the candidate face regions; and storing said identifier for said each recognized face in association with at least one image of said image stream. 8. A method as claimed in claim 1 further comprising tracking candidate face regions of different sizes from a plurality of images of said image stream. 9. A method as claimed in claim 1 further comprising merging said set of candidate face regions with one or more previously detected face regions to provide a set of candidate face regions having different parameters. 10. A method as claimed in claim 1, wherein the method is performed periodically on a selected plurality of images of a reference image stream, wherein said plurality of images include a full resolution main acquired image chronologically following a plurality of preview images. 11. A method as claimed in claim 1, further comprising displaying an acquired image and superimposing one or more indications of one or more tracked candidate face regions on said displayed acquired image. 12. A method as claimed in claim 11 further comprising storing at least one of the size and location of one or more of said set of candidate face regions in association with said main acquired image. 13. A method as claimed in claim 1 further comprising responsive to said acquired image being captured with a flash, analyzing regions of said acquired image corresponding to said tracked candidate face regions for red-eye defects. 14. A method as claimed in claim 1 further comprising performing spatially selective post processing of said main acquired image based on said stored candidate face regions' size or location. 15. A method a claimed in claim 1, wherein said stream of reference images comprises a stream of preview images. 16. A digital image acquisition device for detecting faces in an image stream including one or more optics and a sensor for acquiring said image stream, a processor, and a processor-readable medium having digital code embedded therein for programming the processor to perform a method of tracking faces in an image stream, wherein the method comprises: a. receiving a new acquired image from a reference image stream including one or more face regions; b. receiving an indication of relative movement of said new acquired image relative to a previously acquired image of said reference image stream, said previously acquired image having an associated set of candidate face regions each having a given size and a respective location; and c. applying adjusted face detection to at least a portion of said new acquired image in the vicinity of said candidate face regions as a function of said movement, to provide an updated set of candidate face regions d. applying image processing to said main image based on information regarding said candidate face regions to generate a processed version of the new acquired image; and e. displaying, storing, or transmitting the processed version of the new acquired image, or combinations thereof. 17. The image acquisition device as claimed in claim 16 comprising a motion sensor, said motion sensor comprising an accelerometer and a controlled gain amplifier connected to said accelerometer, said apparatus being arranged to set the gain of said amplifier relatively low for acquisition of a high resolution image and to set the gain of said amplifier relatively high during acquisition of a stream of relatively low resolution images. 18. The image acquisition device as claimed in claim 16 including a motion sensor, said motion sensor comprising a MEMS sensor. 19. The image acquisition device as claimed in claim 16, wherein the method further comprises selectively applying face recognition using a database to at least some of said candidate face regions to provide an identifier for a face recognized in a candidate face region, and storing the identifier for the recognized face in association with the new acquired image. 20. The image acquisition device as claimed in claim 16, wherein the method further comprises merging new candidate face regions with one or more previously detected face regions to provide said updated set of candidate face regions. 21. The image acquisition device as claimed in claim 16, wherein the method further comprises displaying an acquired image; and superimposing an indication of a tracked candidate face region on the displayed acquired image. 22. The image acquisition device as claimed in claim 21, wherein the method further comprises storing at least one of the size and location of a candidate face region in association with the new acquired image. 23. The image acquisition device as claimed in claim 16, wherein the method further comprises, responsive to said new acquired image being captured with a flash, analyzing for red eye defects certain regions of said acquired image based on information regarding said set of candidate face regions. 24. The image acquisition device as claimed in claim 16, wherein the method further comprises performing spatially selective post processing of said new acquired image based on determined size and location of candidate face regions. 25. The image acquisition device of as claimed in claim 16, wherein said stream of reference images comprises a stream of preview images. 26. A method of detecting faces in a reference image stream using a digital image acquisition device comprising: a. receiving a first acquired image from said reference image stream including one or more face regions; b. sub-sampling said first acquired image at a specified resolution one or more times to provide one or more sub-sampled images; c. identifying one or more regions of said first acquired image including said one or more face regions within said one or more subsampled images of said first acquired image with probabilities each above a predetermined threshold; d. determining a respective size and location of each identified face region within said first acquired image; e. receiving a second acquired image from said reference image stream, and sub-sampling and applying face detection to one or more regions of said subsequent acquired image calculated as probably including one or more face regions corresponding to said one or more face regions identified in said first acquired image; f. acquiring a full resolution main image and applying image processing based on said face detection applied to said first and second images of said reference image stream g. displaying, storing, or transmitting the processed version of said main image, or combinations thereof. 27. A method as claimed in claim 26 wherein said identifying is performed on said sub-sampled image. 28. A method as claimed in claim 26 wherein said face detection is performed with relaxed face detection parameters. 29. A method as claimed in claim 26 further comprising for a particular candidate face region associated with a previously acquired image of said image stream, enhancing a contrast of luminance characteristics of corresponding regions of said main image. 30. A method as claimed in claim 29 wherein said enhancing is performed on said sub-sampled image. 31. A method as claimed in claim 26 wherein each new acquired image is acquired with progressively increased exposure parameters until at least one candidate face region is detected. 32. A method as claimed in claim 26, further comprising tracking candidate face regions of different parameters from a plurality of images of said image stream. 33. A digital image acquisition device for detecting faces in an image stream including one or more optics and a sensor for acquiring said image stream, a processor, and a processor-readable medium having digital code embedded therein for programming the processor to perform a method of detecting faces in the image stream, wherein the method comprises: a. receiving a first acquired image from said reference image stream including one or more face regions; b. sub-sampling said first acquired image at a specified resolution one or more times to provide one or more sub-sampled images; c. identifying one or more regions of said first acquired image including said one or more face regions within said one or more subsampled images of said first acquired image with probabilities each above a predetermined threshold; d. determining a respective size and location of each identified face region within said first acquired image; e. receiving a second acquired image from said reference image stream, and sub-sampling and applying face detection to one or more regions of said subsequent acquired image calculated as probably including one or more more face regions corresponding to said one or more face regions identified in said first acquired image; f. acquiring a full resolution main image and applying image processing based on said face detection applied to said first and second images of said reference image stream; and g. displaying, storing, or transmitting the processed version of said main image, or combinations thereof. 34. A device as claimed in claim 33 wherein said identifying is performed on said sub-sampled image. 35. A device as claimed in claim 33 wherein said face detection is performed with relaxed face detection parameters. 36. A device as claimed in claim 33, further comprising for a candidate face region associated with a previously acquired image, enhancing a contrast of luminance characteristics of corresponding regions of said main image. 37. A device as claimed in claim 33 wherein said enhancing is performed on said sub-sampled image. 38. A device as claimed in claim 33 wherein a face detection mode of said digital image acquisition device, each new acquired image is acquired with progressively increased exposure parameters until at least one candidate face region is detected. 39. A device as claimed in claim 33, further comprising selectively apply face recognition using a database to said candidate face regions to provide an identifier for a face recognized in a candidate face region; and storing the identifier for the recognized face in association with the main image. 40. A device as claimed in claim 33 further comprising tracking one or more candidate face regions within a plurality of images of said image stream.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (232)
Suzuki Shinichi (Tokyo JPX) Yasukawa Seiichi (Kawasaki JPX) Sato Toshihiro (Yokohama JPX) Narisawa Tsutomu (Saitama JPX), A photo taking apparatus capable of making a photograph with flash by a flash device.
White,Timothy J.; Blanco,Felix; Gerard,Michael J.; Leem,Yojin; Kurtenbach,Thomas J.; Christoffel,Douglas W.; Delong,Kevin R.; Smith,Craig M., Apparatus and method for processing digital images having eye color defects.
Hutcheson Timothy L. (Los Gatos CA) Or Wilson (Santa Clara CA) Narayanan Venkatesh (Fremont CA) Mohan Subramaniam (Sunnyvale CA) Wohlmut Peter G. (Saratoga CA) Srinivasan Ramanujam (Sunnyvale CA) Hun, Apparatus for generating a feature matrix based on normalized out-class and in-class variation matrices.
Benati Paul J. (Webster NY) Gray Robert T. (Rochester NY) Cosgrove Patrick A. (Honeoye Falls NY), Automated detection and correction of eye color defects due to flash illumination.
Eleftheriadis Alexandros ; Jacquin Arnaud Eric, Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video.
Harshaw Robert C. (Dallas TX) Burkey Ronald S. (Dallas TX) Doell James T. (Dallas TX) Keith Dennis G. (Dallas TX), Computerized checklist with predetermined sequences of sublists which automatically returns to skipped checklists.
Nesterov, Victor Anatol'evich; Khvatov, Vladimir Alezandrovich; Lalyko, Leonid Borisovich; Zaklika, Kryzstof Antoni, Correction of “red-eye” effects in images.
Matsuo, Hideaki; Imagawa, Kazuyuki; Takata, Yuji; Baba, Naruatsu; Ejima, Toshiaki, Device and method for face image extraction, and recording medium having recorded program for the method.
Buhr John D. ; Goodwin Robert M. ; Koeng Frederick R. ; Rivera Jose E., Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing.
Peter Fellegara ; Richard W. Lourette ; Michael E. Miller ; Linda M. Antos ; Robert H. Hibbard, Electronic camera with quick review of last captured image.
Parulski Kenneth A. (Rochester NY) Napoli Thomas A. (Rochester NY) Lewis David M. (Waterport NY), Electronic still camera for capturing and categorizing images.
Kuchta Daniel W. (Brockport NY) Sucy Peter J. (Hamlin NY), Electronic still camera providing multi-format storage of full and reduced resolution images.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Prasad K. Venkatesh (Cupertino CA) Stork David G. (Stanford CA), Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system.
Hanna, Keith James; Burt, Peter J.; Peleg, Shmuel; Dixon, Douglas F.; Mishra, Deepam; Wixson, Lambert E.; Mandlebaum, Robert; Coyle, Peter; Herman, Joshua R., Fully automated iris recognition system utilizing wide and narrow fields of view.
Poggio Tomaso ; Beymer David ; Jones Michael ; Vetter Thomas,DEX, Image compression by pointwise prototype correspondence using shape and texture information.
Lu Daozheng (Buffalo Grove IL) Kiewit David A. (Palm Harbor FL) Zhang Jia (Mundelein IL), Market research method and system for collecting retail store and shopper market research data.
Brogliatti, Barbara Spencer; Grakal, Christopher; Janney, Lisa A.; O'Neil, Marisa B.; Smith, Thomas G., Method and apparatus for archiving in and retrieving images from a digital image library.
Anderson, Eric C.; Bernstein, John D.; Pavely, John F.; Alsing, Carl J., Method and apparatus for defining a panning and zooming path across a still image during movie creation.
Gorday, Robert Mark; Gorday, Paul Edward; Eaton, Eric Thomas; Sibecas, Salvador, Method and apparatus for limiting storage or transmission of visual information.
Bedell Jeffrey L. (Arlington MA) Cockroft Gregory (Santa Clara CA) Peters Eric C. (Carlisle MA) Warner William J. (Weston MA), Method and apparatus for manipulating digital video data.
Fujio Noguchi ; Kazuhiko Akaike JP; Setsuko Watanabe Blaszkowski ; Noriko Kotabe GB; Takashi Otani JP; Tadashi Kajiwara, Method and apparatus for providing favorite station and programming information in a multiple station broadcast system.
Tal Peter (53 Driftwood Dr. Port Washington NY 11050), Method and apparatus for uniquely identifying individuals by particular physical characteristics and security system uti.
Zanzucchi,Peter John; Moroney, III,Richard Morgan; Aceti,John Gregory; Pletcher,Timothy Allen; Burstyn,Herschel Clement, Method and imager for detecting the location of objects.
Eckes,Christian; Kefalea,Efthimia; Von Der Malsburg,Chrstoph; P철tzsch,Michael; Rinne,Michael; Triesch,Jochen; Vorbr체ggen,Jan C., Method for recognizing objects in digitized images.
Steinberg,Eran; Prilutsky,Yury; Corcoran,Peter; Bigioi,Petronel, Method of improving orientation and color balance of digital images using face detection information.
Brunelli Roberto,ITX ; Mich Ornella,ITX, Method of storing and retrieving images of people, for example, in photographic archives and for the construction of id.
Ogrinc Michael A. (San Francisco CA) Card Robert A. (Palo Alto CA) Burns Chris R. (Mountain View CA) Clarke Charles P. (Los Altos CA) Collier Ronda L. (Scotts Valley CA) Collins Kevin M. (San Mateo C, Real time video image processing system.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Bigioi,Petronel, Real-time face tracking in a digital image acquisition device.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Biglol,Petronel, Real-time face tracking in a digital image acquisition device.
Ianculescu,Mihai; Bigioi,Petronel; Gangea,Mihnea; Petrescu,Stefan; Corcoran,Peter; Steinberg,Eran, Real-time face tracking in a digital image acquisition device.
Steinberg,Eran; Corcoran,Peter; Bigioi,Petronel; Pososin,Alexei; Drimbarean,Alexandru; Nanu,Florin; Petrescu,Stefan, Real-time face tracking in a digital image acquisition device.
Bortolussi Jay F. ; Cusack ; Jr. Francis J. ; Ehn Dennis C. ; Kuzeja Thomas M. ; Saulnier Michael S., Real-time facial recognition and verification system.
Okubo,Atsushi; Sabe,Kohtaro; Kawamoto,Kenta; Fukuchi,Masaki, Robot device and face identifying method, and image identifying device and image identifying method.
Maeda Yutaka (Kanagawa JPX) Kyoden Yasuhiro (Sagamihara JPX) Naruto Hirokazu (Higashiosaka JPX) Tanaka Yoshito (Sakai JPX) Shintani Dai (Sakai JPX) Nanba Katsuyuki (Osakasayama JPX), Still video camera having a printer capable of printing a photographed image in a plurality of printing modes.
Mashimo Yukio (Tokyo JA) Sakurada Nobuaki (Kanagawa JA) Ito Tadashi (Kanagawa JA) Ito Fumio (Kanagawa JA) Shinoda Nobuhiko (Tokyo JA), System for exposure measurement and/or focus detection by means of image senser.
Freeman William T. ; Leventon Michael E., System for reconstructing the 3-dimensional motions of a human figure from a monocularly-viewed image sequence.
Kuperstein Michael ; Kottas James A., System, method and application for the recognition, verification and similarity ranking of facial or other object patterns.
Wheeler Richard B. (Webster NY), Technique suited for use in multi-zone autofocusing cameras for improving image quality for non-standard display sizes a.
Kojima Kazuaki (Nagaokakyo JPX) Kuno Tetsuya (Nagaokakyo JPX) Sugiura Hiroaki (Nagaokakyo JPX) Yamada Takeshi (Nagaokakyo JPX), Video signal processor for detecting flesh tones in am image.
Jain Ramesh ; Horowitz Bradley ; Fuller Charles E. ; Gupta Amarnath ; Bach Jeffrey R. ; Shu Chiao-fe, Visual image database search engine which allows for different schema.
Chang, Soon-keun; Ahn, Eun-sun, Digital image processing apparatus, tracking method, recording medium for storing computer program for executing the tracking method, and digital image processing apparatus adopting the tracking method.
Corcoran, Peter; Bigioi, Petronel; Stec, Piotr, Face and other object detection and tracking in off-center peripheral regions for nonlinear lens geometries.
Steinberg, Eran; Prilutsky, Yury; Pososin, Alexei; Bigioi, Petronel; Zamfir, Adrian; Drimbarean, Alexandru; Corcoran, Peter, Method of gathering visual meta data using a reference image.
Tsagkatakis, Grigorios; Savakis, Andreas, Methods for tracking objects using random projections, distance learning and a hybrid template library and apparatuses thereof.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Petrescu, Stefan; Corcoran, Peter; Steinberg, Eran; Bigioi, Petronel; Drimbarean, Alexandru, Real-time face tracking in a digital image acquisition device.
Banerjee, Amit; Burlina, Phillippe M.; Broadwater, Joshua B., Systems and methods for remote tagging and tracking of objects using hyperspectral video sensors.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.