Separating a directional lighting variability in statistical face modelling based on texture space decomposition
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06K-009/46
출원번호
US-0203807
(2008-09-03)
등록번호
US-8224039
(2012-07-17)
발명자
/ 주소
Ionita, Mircea
Corcoran, Peter
Bacivarov, Ioana
출원인 / 주소
DigitalOptics Corporation Europe Limited
대리인 / 주소
Smith, Andrew V.
인용정보
피인용 횟수 :
21인용 특허 :
199
초록▼
A technique for determining a characteristic of a face or certain other object within a scene captured in a digital image including acquiring an image and applying a linear texture model that is constructed based on a training data set and that includes a class of objects including a first subset of
A technique for determining a characteristic of a face or certain other object within a scene captured in a digital image including acquiring an image and applying a linear texture model that is constructed based on a training data set and that includes a class of objects including a first subset of model components that exhibit a dependency on directional lighting variations and a second subset of model components which are independent of directional lighting variations. A fit of the model to the face or certain other object is obtained including adjusting one or more individual values of one or more of the model components of the linear texture model. Based on the obtained fit of the model to the face or certain other object in the scene, a characteristic of the face or certain other object is determined.
대표청구항▼
1. A method of determining a characteristic of a face within a scene captured in a digital image, comprising: building a first model from a plurality of images including different individual faces, each acquired independently of directional lighting variations, said model comprising a mean, shape ve
1. A method of determining a characteristic of a face within a scene captured in a digital image, comprising: building a first model from a plurality of images including different individual faces, each acquired independently of directional lighting variations, said model comprising a mean, shape vector (s), a mean texture vector (t), and a first texture vector (bt) for each face;building respective second models from respective sets of images, each set acquired for a given individual with varying directional lighting, said respective second models comprising said mean shape vector (s) and respective second texture vectors (g) for said images;projecting said second texture vectors (g) onto the subspace spanned by the first model to provide a filtered texture vector (gfilt)for each image of said sets of images;subtracting said filtered texture vector (gfilt) from said second texture vectors (g) to provide a residual texture vector (gres) for each image of said sets of images;building a second model orthogonal to said first model for said sets of images based on a mean of said residual texture vectors (gres), said second model including a texture vector (bg) for each image;fusing said first and second texture (bt, bg) vectors for each image to provide a fused texture model (tfused);acquiring a digital image including a face within a scene;determining an initial location of the face in the scene;applying said fused model to said initial location to obtain a active-appearance based fit of said fused model to said face;based on the obtained fit of the fused model to said face in the scene, determining at least one characteristic of the face; andelectronically storing, transmitting, applying a face recognition program to, editing, or displaying the face including the determined characteristic, or combinations thereof. 2. The method of claim 1, wherein the model components comprise eigenvectors, and the texture values comprises eigenvalues of the eigenvectors. 3. The method of claim 1, Wherein the at least one determined characteristic comprises a feature that is independent of directional lighting. 4. The method of claim 1, further comprising generating a reconstructed image from said acquired digital image without periodic noise component, including obtaining a second fit of the face to a second linear texture model that is based on a training data set and that comprises a class of objects including a set of model components which are without a periodic noise component. 5. The method of claim 4, further comprising: extracting the periodic noise component including determining a difference between the face and the reconstructed image, anddetermining a frequency of the noise component; andremoving the periodic noise component of the determined frequency. 6. The method of claim 1, further comprising determining an exposure value for the face of said acquired digital image, including obtaining a fit to the face to a second linear texture model that is based on a training data set and that comprises a class of objects including a set of model components that exhibit a dependency on exposure value variations. 7. The method of claim 6, further comprising including reducing an effect of a background region or density contrast caused by shadow or both. 8. The method of claim 1, further comprising controlling a flash for acquiring said digital image to accurately reflect a lighting condition, including obtaining a flash control condition by referring to a reference table and controlling a flash light emission according to the flash control condition. 9. The method of claim 8, further Comprising reducing an effect of contrasting density caused by shadow or black compression or white compression or combinations thereof. 10. The method of claim 1, further comprising adjusting or determining a sharpness value, or both, of said acquired digital image including: applying a second linear texture model that is constructed based on a training data set and comprises a class of objects including a subset of model components that exhibit a dependency on sharpness variations,obtaining a fit of said second model to said face in the scene including adjusting one or more individual values of one or more model components of said second linear texture model; andbased on the obtained fit of the second model to said face in the scene, adjusting a sharpness of the face including changing one or more values of one or more model components of the second linear texture model to generate a further adjusted object model. 11. The method of claim 1, further comprising removing a blemish from a face of said acquired digital image, including: applying a second linear texture model that is constructed based on a training data set and comprises a class of objects including a subset of model components that do not include such a blemish;obtaining a fit of said second model to said face in the scene including adjusting one or more individual values of one or more model components of said second linear texture model; andbased on the obtained fit of the second model to said face in the scene, removing the blemish from the face including changing one or more values of one or more model components of the second linear texture model to generate a further adjusted object model. 12. The method of claim 11, wherein the blemish comprises an acne blemish or other skin blemish; or a photographic artefact. 13. The method of claim 1, further comprising adjusting or determining a graininess value, or both, of said acquired digital image including: applying a second linear texture model that is constructed based on a training data set and comprises a class of objects including a subset of model components that exhibit a dependency on graininess variations,obtaining a fit of said second model to said face in the scene including adjusting one or more individual values of one or more model components of said second linear texture model; andbased on the obtained fit of the second model to said face in the scene, adjusting a graininess of the face including changing one or more values of one or more model components of the second linear texture model to generate a further adjusted object model. 14. The method of claim 1, further comprising converting, adjusting or determining a resolution value, or combinations thereof, of said acquired digital image including: applying a second linear texture model that is constructed based on a training data set and comprises a class of objects including a subset of model components that exhibit approximately a same resolution as said face,obtaining a fit of said second model to said face in the scene including adjusting one or more individual values of one or more model components of said second linear texture model; andbased on the obtained fit of the second model to said face in the scene, converting a resolution of the face including changing one or more values of one or more model components of the second linear texture model to generate a further adjusted object model. 15. A digital image acquisition device including an optoelectonic system for acquiring a digital image, and a digital memory having stored therein processor-readable code for programming the processor to perform a method of determining a characteristic of a face within a scene captured in a digital image, according to any of claims 1-14. 16. A non-transitory digital memory having stored therein processor-readable code for programming a processor to perform a method of determining a characteristic of a face within a scene captured in a digital image, according to any of claims 1-14.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (199)
Suzuki Shinichi (Tokyo JPX) Yasukawa Seiichi (Kawasaki JPX) Sato Toshihiro (Yokohama JPX) Narisawa Tsutomu (Saitama JPX), A photo taking apparatus capable of making a photograph with flash by a flash device.
White,Timothy J.; Blanco,Felix; Gerard,Michael J.; Leem,Yojin; Kurtenbach,Thomas J.; Christoffel,Douglas W.; Delong,Kevin R.; Smith,Craig M., Apparatus and method for processing digital images having eye color defects.
Hutcheson Timothy L. (Los Gatos CA) Or Wilson (Santa Clara CA) Narayanan Venkatesh (Fremont CA) Mohan Subramaniam (Sunnyvale CA) Wohlmut Peter G. (Saratoga CA) Srinivasan Ramanujam (Sunnyvale CA) Hun, Apparatus for generating a feature matrix based on normalized out-class and in-class variation matrices.
Benati Paul J. (Webster NY) Gray Robert T. (Rochester NY) Cosgrove Patrick A. (Honeoye Falls NY), Automated detection and correction of eye color defects due to flash illumination.
Eleftheriadis Alexandros ; Jacquin Arnaud Eric, Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video.
Harshaw Robert C. (Dallas TX) Burkey Ronald S. (Dallas TX) Doell James T. (Dallas TX) Keith Dennis G. (Dallas TX), Computerized checklist with predetermined sequences of sublists which automatically returns to skipped checklists.
Matsuo, Hideaki; Imagawa, Kazuyuki; Takata, Yuji; Baba, Naruatsu; Ejima, Toshiaki, Device and method for face image extraction, and recording medium having recorded program for the method.
Buhr John D. ; Goodwin Robert M. ; Koeng Frederick R. ; Rivera Jose E., Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing.
Parulski Kenneth A. (Rochester NY) Napoli Thomas A. (Rochester NY) Lewis David M. (Waterport NY), Electronic still camera for capturing and categorizing images.
Kuchta Daniel W. (Brockport NY) Sucy Peter J. (Hamlin NY), Electronic still camera providing multi-format storage of full and reduced resolution images.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Prasad K. Venkatesh (Cupertino CA) Stork David G. (Stanford CA), Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system.
Poggio Tomaso ; Beymer David ; Jones Michael ; Vetter Thomas,DEX, Image compression by pointwise prototype correspondence using shape and texture information.
Lu Daozheng (Buffalo Grove IL) Kiewit David A. (Palm Harbor FL) Zhang Jia (Mundelein IL), Market research method and system for collecting retail store and shopper market research data.
Brogliatti, Barbara Spencer; Grakal, Christopher; Janney, Lisa A.; O'Neil, Marisa B.; Smith, Thomas G., Method and apparatus for archiving in and retrieving images from a digital image library.
Anderson, Eric C.; Bernstein, John D.; Pavely, John F.; Alsing, Carl J., Method and apparatus for defining a panning and zooming path across a still image during movie creation.
Bedell Jeffrey L. (Arlington MA) Cockroft Gregory (Santa Clara CA) Peters Eric C. (Carlisle MA) Warner William J. (Weston MA), Method and apparatus for manipulating digital video data.
Fujio Noguchi ; Kazuhiko Akaike JP; Setsuko Watanabe Blaszkowski ; Noriko Kotabe GB; Takashi Otani JP; Tadashi Kajiwara, Method and apparatus for providing favorite station and programming information in a multiple station broadcast system.
Tal Peter (53 Driftwood Dr. Port Washington NY 11050), Method and apparatus for uniquely identifying individuals by particular physical characteristics and security system uti.
Zanzucchi,Peter John; Moroney, III,Richard Morgan; Aceti,John Gregory; Pletcher,Timothy Allen; Burstyn,Herschel Clement, Method and imager for detecting the location of objects.
Eckes,Christian; Kefalea,Efthimia; Von Der Malsburg,Chrstoph; P철tzsch,Michael; Rinne,Michael; Triesch,Jochen; Vorbr체ggen,Jan C., Method for recognizing objects in digitized images.
Steinberg,Eran; Prilutsky,Yury; Corcoran,Peter; Bigioi,Petronel, Method of improving orientation and color balance of digital images using face detection information.
Ogrinc Michael A. (San Francisco CA) Card Robert A. (Palo Alto CA) Burns Chris R. (Mountain View CA) Clarke Charles P. (Los Altos CA) Collier Ronda L. (Scotts Valley CA) Collins Kevin M. (San Mateo C, Real time video image processing system.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Biglol,Petronel, Real-time face tracking in a digital image acquisition device.
Ianculescu,Mihai; Bigioi,Petronel; Gangea,Mihnea; Petrescu,Stefan; Corcoran,Peter; Steinberg,Eran, Real-time face tracking in a digital image acquisition device.
Okubo,Atsushi; Sabe,Kohtaro; Kawamoto,Kenta; Fukuchi,Masaki, Robot device and face identifying method, and image identifying device and image identifying method.
Maeda Yutaka (Kanagawa JPX) Kyoden Yasuhiro (Sagamihara JPX) Naruto Hirokazu (Higashiosaka JPX) Tanaka Yoshito (Sakai JPX) Shintani Dai (Sakai JPX) Nanba Katsuyuki (Osakasayama JPX), Still video camera having a printer capable of printing a photographed image in a plurality of printing modes.
Mashimo Yukio (Tokyo JA) Sakurada Nobuaki (Kanagawa JA) Ito Tadashi (Kanagawa JA) Ito Fumio (Kanagawa JA) Shinoda Nobuhiko (Tokyo JA), System for exposure measurement and/or focus detection by means of image senser.
Mashimo Yukio (Tokyo JPX) Sakurada Nobuaki (Kanagawa JPX) Ito Tadashi (Kanagawa JPX) Ito Fumio (Kanagawa JPX) Shinoda Nobuhiko (Tokyo JPX), System for exposure measurement and/or focus detection by means of image sensor.
Kuperstein Michael ; Kottas James A., System, method and application for the recognition, verification and similarity ranking of facial or other object patterns.
Wheeler Richard B. (Webster NY), Technique suited for use in multi-zone autofocusing cameras for improving image quality for non-standard display sizes a.
Kojima Kazuaki (Nagaokakyo JPX) Kuno Tetsuya (Nagaokakyo JPX) Sugiura Hiroaki (Nagaokakyo JPX) Yamada Takeshi (Nagaokakyo JPX), Video signal processor for detecting flesh tones in am image.
Jain Ramesh ; Horowitz Bradley ; Fuller Charles E. ; Gupta Amarnath ; Bach Jeffrey R. ; Shu Chiao-fe, Visual image database search engine which allows for different schema.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Bigioi, Petronel; Ciuc, Mihai; Ciurel, Stefanita; Verlan, Constantin, Classification and organization of consumer digital images using workflow, and face detection and recognition.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Bigioi, Petronel; Ciuc, Mihai; Ciurel, Stefanita; Vertan, Constantin, Classification and organization of consumer digital images using workflow, and face detection and recognition.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Bigioi, Petronel; Ciuc, Mihai; Ciurel, Stefanita; Vertan, Constantin, Classification and organization of consumer digital images using workflow, and face detection and recognition.
Ionita, Mircea; Bacivarov, Ioana; Corcoran, Peter, Separating directional lighting variability in statistical face modelling based on texture space decomposition.
Ionita, Mircea; Bacivarov, Ioana; Corcoran, Peter, Separating directional lighting variability in statistical face modelling based on texture space decomposition.
Ionita, Mircea; Cocoran, Peter; Bacivarov, Ioana, Separating directional lighting variability in statistical face modelling based on texture space decomposition.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.