Automatic face and skin beautification using face detection
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/228
G06K-009/40
G06T-005/00
G06K-009/00
G06T-011/60
H04N-005/232
H04N-005/262
H04N-009/04
H04N-101/00
출원번호
US-0512843
(2009-07-30)
등록번호
US-9007480
(2015-04-14)
발명자
/ 주소
Ciuc, Mihai
Capata, Adrian
Mocanu, Valentin
Pososin, Alexei
Florea, Corneliu
Corcoran, Peter
출원인 / 주소
FotoNation Limited
대리인 / 주소
Hickman Palermo Becker Bingham LLP
인용정보
피인용 횟수 :
6인용 특허 :
249
초록▼
Sub-regions within a face image are identified to be enhanced by applying a localized smoothing kernel to luminance data corresponding to the sub-regions of the face image. An enhanced face image is generated including an enhanced version of the face that includes certain original pixels in combinat
Sub-regions within a face image are identified to be enhanced by applying a localized smoothing kernel to luminance data corresponding to the sub-regions of the face image. An enhanced face image is generated including an enhanced version of the face that includes certain original pixels in combination with pixels corresponding to the one or more enhanced sub-regions of the face.
대표청구항▼
1. A method of enhancing an appearance of a face within a digital image, comprising one or more processors performing the steps of: acquiring a digital image of a scene including a face,wherein acquiring the digital image includes capturing the image using a lens and an image sensor, orreceiving sai
1. A method of enhancing an appearance of a face within a digital image, comprising one or more processors performing the steps of: acquiring a digital image of a scene including a face,wherein acquiring the digital image includes capturing the image using a lens and an image sensor, orreceiving said image following capture by a device that includes a lens and an image sensor, ora combination thereof;identifying the face within the digital image;identifying within the face two or more skin tone portions to be enhanced with localized luminance smoothing;applying one or more localized luminance smoothing kernels to at least one skin tone portion of the one or more skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face,wherein applying the one or more localized luminance smoothing kernels comprises: determining an amount of difference between a luminance value of a current pixel of the at least one skin tone portion and a local average luminance value of the at least one skin tone portion;determining whether the amount of difference between the luminance value of the current pixel and the local average luminance is less than a particular threshold amount;determining a weight of smoothing to apply to the current pixel by the one or more localized smoothing kernels by: increasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is less than the particular threshold amount; ordecreasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is not less than the particular threshold amount;applying the one or more localized luminance smoothing kernels only to luminance data of the at least one skin tone portion;generating an enhanced image including an enhanced version of the face comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced skin tone portions of the face; anddisplaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. 2. The method of claim 1, wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof. 3. The method of claim 1, further comprising: applying one or more localized color smoothing kernels to one or more blemish regions identified within one or more of the skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, andwherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized color smoothing. 4. The method of claim 1, further comprising: applying noise reduction or enhancement, or both, to the one or more skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, andwherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both. 5. The method of claim 1, further comprising: determining certain non-skin tone pixels within the one or more skin tone portions that do not comprise a threshold skin tone, andremoving, replacing, reducing an intensity of, or modifying a color of said certain non-skin tone pixels, or combinations thereof. 6. The method of claim 1, wherein: enhanced pixels of the one or more enhanced skin tone portions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced skin tone portions, or combinations thereof. 7. The method of claim 1, further comprising: detecting one or more mouth or eye regions, or combinations thereof, within the face, andidentifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof. 8. The method of claim 1, further comprising: classifying the face according to its age based on comparing one or more default image attribute values with one or more determined values; andadjusting one or more camera acquisition or post-processing parameters, or combinations thereof, based on the classifying of the face according to its age. 9. A digital image acquisition device, comprising a lens, an image sensor and a processor, and a processor-readable memory having embodied therein processor-readable code for programming the processor to perform a method of enhancing an appearance of a face within a digital image, wherein the method comprises: acquiring a digital image of a scene including a face,wherein acquiring the digital image includes capturing the image using a lens and an image sensor, orreceiving said image following capture by a device that includes a lens and an image sensor, ora combination thereof;identifying the face within the digital image;identifying within the face two or more skin tone portions to be enhanced with localized luminance smoothing;applying one or more localized luminance smoothing kernels to at least one skin tone portion of the one or more skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face,wherein applying the one or more localized luminance smoothing kernels comprises: determining an amount of difference between a luminance value of a current pixel of the at least one skin tone portion and a local average luminance value of the at least one skin tone portion;determining whether the amount of difference between the luminance value of the current pixel and the local average luminance is less than a particular threshold amount;determining a weight of smoothing to apply to the current pixel by the one or more localized smoothing kernels by: increasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is less than the particular threshold amount; ordecreasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is not less than the particular threshold amount;applying the one or more localized luminance smoothing kernels only to luminance data of the at least one skin tone portion;generating an enhanced image including an enhanced version of the face comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced skin tone portions of the face; anddisplaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. 10. The device of claim 9, wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof. 11. The device of claim 9, wherein the method further comprises applying one or more localized color smoothing kernels to one or more blemish regions identified within one or more of the skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, and wherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized color smoothing. 12. The device of claim 9, wherein the method further comprises applying noise reduction or enhancement, or both, to the one or more skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, and wherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both. 13. The device of claim 9, wherein the method further comprises determining certain non-skin tone pixels within the one or more skin tone portions that do not comprise a threshold skin tone, and removing, replacing, reducing an intensity of, or modifying a color of said certain non-skin tone pixels, or combinations thereof. 14. The device of claim 9, wherein enhanced pixels of the one or more enhanced skin tone portions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced skin tone portions, or combinations thereof. 15. The device of claim 9, wherein the method further comprises detecting one or more mouth or eye regions, or combinations thereof, within the face, and identifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof. 16. The device of claim 9, wherein the method further comprises classifying the face according to its age based on comparing one or more default image attribute values with one or more determined values; and adjusting one or more camera acquisition or post-processing parameters, or combinations thereof, based on the classifying of the face according to its age. 17. One or more non-transitory processor-readable media having embodied therein code for programming one or more processors to perform a method of enhancing an appearance of a face within a digital image, wherein the method comprises: acquiring a digital image of a scene including a face, wherein acquiring the digital image includes capturing the image using a lens and an image sensor, orreceiving said image following capture by a device that includes a lens and an image sensor, ora combination thereof;identifying the face within the digital image;identifying within the face two or more skin tone portions to be enhanced with localized luminance smoothing;applying one or more localized luminance smoothing kernels to at least one skin tone portion of the one or more skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face,wherein applying the one or more localized luminance smoothing kernels comprises: determining an amount of difference between a luminance value of a current pixel of the at least one skin tone portion and a local average luminance value of the at least one skin tone portion;determining whether the amount of difference between the luminance value of the current pixel and the local average luminance is less than a particular threshold amount;determining a weight of smoothing to apply to the current pixel by the one or more localized smoothing kernels by: increasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is less than the particular threshold amount; ordecreasing a prior smoothing weight if the amount of difference between the luminance value of the current pixel and the local average luminance is not less than the particular threshold amount;applying the one or more localized luminance smoothing kernels only to luminance data of the at least one skin tone portion;generating an enhanced image including an enhanced version of the face comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced skin tone portions of the face; anddisplaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. 18. The one or more processor-readable media of claim 17, wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof. 19. The one or more processor-readable media of claim 17, wherein the method further comprises applying one or more localized color smoothing kernels to one or more blemish regions identified within one or more of the skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, and wherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized color smoothing. 20. The one or more processor-readable media of claim 17, wherein the method further comprises applying noise reduction or enhancement, or both, to the one or more skin tone portions or one or more non-skin tone face features including one or both eyes or a mouth, or combinations thereof, and wherein the enhanced version of the face of the enhanced image further comprises pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both. 21. The one or more processor-readable media of claim 17, wherein the method further comprises determining certain non-skin tone pixels within the one or more skin tone portions that do not comprise a threshold skin tone, and removing, replacing, reducing an intensity of, or modifying a color of said certain nonskin tone pixels, or combinations thereof. 22. The one or more processor-readable media of claim 17, wherein enhanced pixels of the one or more enhanced skin tone portions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced skin tone portions, or combinations thereof. 23. The one or more processor-readable media of claim 17, wherein the method further comprises detecting one or more mouth or eye regions, or combinations thereof, within the face, and identifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof. 24. The one or more processor-readable media of claim 1, wherein the method further comprises classifying the face according to its age based on comparing one or more default image attribute values with one or more determined values; and adjusting one or more camera acquisition or post-processing parameters, or combinations thereof, based on the classifying of the face according to its age.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (249)
Suzuki Shinichi (Tokyo JPX) Yasukawa Seiichi (Kawasaki JPX) Sato Toshihiro (Yokohama JPX) Narisawa Tsutomu (Saitama JPX), A photo taking apparatus capable of making a photograph with flash by a flash device.
White,Timothy J.; Blanco,Felix; Gerard,Michael J.; Leem,Yojin; Kurtenbach,Thomas J.; Christoffel,Douglas W.; Delong,Kevin R.; Smith,Craig M., Apparatus and method for processing digital images having eye color defects.
Hutcheson Timothy L. (Los Gatos CA) Or Wilson (Santa Clara CA) Narayanan Venkatesh (Fremont CA) Mohan Subramaniam (Sunnyvale CA) Wohlmut Peter G. (Saratoga CA) Srinivasan Ramanujam (Sunnyvale CA) Hun, Apparatus for generating a feature matrix based on normalized out-class and in-class variation matrices.
Benati Paul J. (Webster NY) Gray Robert T. (Rochester NY) Cosgrove Patrick A. (Honeoye Falls NY), Automated detection and correction of eye color defects due to flash illumination.
Eleftheriadis Alexandros ; Jacquin Arnaud Eric, Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video.
Harshaw Robert C. (Dallas TX) Burkey Ronald S. (Dallas TX) Doell James T. (Dallas TX) Keith Dennis G. (Dallas TX), Computerized checklist with predetermined sequences of sublists which automatically returns to skipped checklists.
Nesterov, Victor Anatol'evich; Khvatov, Vladimir Alezandrovich; Lalyko, Leonid Borisovich; Zaklika, Kryzstof Antoni, Correction of “red-eye” effects in images.
Matsuo, Hideaki; Imagawa, Kazuyuki; Takata, Yuji; Baba, Naruatsu; Ejima, Toshiaki, Device and method for face image extraction, and recording medium having recorded program for the method.
Buhr John D. ; Goodwin Robert M. ; Koeng Frederick R. ; Rivera Jose E., Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing.
Peter Fellegara ; Richard W. Lourette ; Michael E. Miller ; Linda M. Antos ; Robert H. Hibbard, Electronic camera with quick review of last captured image.
Parulski Kenneth A. (Rochester NY) Napoli Thomas A. (Rochester NY) Lewis David M. (Waterport NY), Electronic still camera for capturing and categorizing images.
Kuchta Daniel W. (Brockport NY) Sucy Peter J. (Hamlin NY), Electronic still camera providing multi-format storage of full and reduced resolution images.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Prasad K. Venkatesh (Cupertino CA) Stork David G. (Stanford CA), Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system.
Hanna, Keith James; Burt, Peter J.; Peleg, Shmuel; Dixon, Douglas F.; Mishra, Deepam; Wixson, Lambert E.; Mandlebaum, Robert; Coyle, Peter; Herman, Joshua R., Fully automated iris recognition system utilizing wide and narrow fields of view.
Poggio Tomaso ; Beymer David ; Jones Michael ; Vetter Thomas,DEX, Image compression by pointwise prototype correspondence using shape and texture information.
Lu Daozheng (Buffalo Grove IL) Kiewit David A. (Palm Harbor FL) Zhang Jia (Mundelein IL), Market research method and system for collecting retail store and shopper market research data.
Brogliatti, Barbara Spencer; Grakal, Christopher; Janney, Lisa A.; O'Neil, Marisa B.; Smith, Thomas G., Method and apparatus for archiving in and retrieving images from a digital image library.
Anderson, Eric C.; Bernstein, John D.; Pavely, John F.; Alsing, Carl J., Method and apparatus for defining a panning and zooming path across a still image during movie creation.
Gorday, Robert Mark; Gorday, Paul Edward; Eaton, Eric Thomas; Sibecas, Salvador, Method and apparatus for limiting storage or transmission of visual information.
Bedell Jeffrey L. (Arlington MA) Cockroft Gregory (Santa Clara CA) Peters Eric C. (Carlisle MA) Warner William J. (Weston MA), Method and apparatus for manipulating digital video data.
Fujio Noguchi ; Kazuhiko Akaike JP; Setsuko Watanabe Blaszkowski ; Noriko Kotabe GB; Takashi Otani JP; Tadashi Kajiwara, Method and apparatus for providing favorite station and programming information in a multiple station broadcast system.
Steinberg, Eran; Corcoran, Peter; Prilutsky, Yury; Biglol, Petronel; Nanu, Florin, Method and apparatus for red-eye detection in an acquired digital image.
Tal Peter (53 Driftwood Dr. Port Washington NY 11050), Method and apparatus for uniquely identifying individuals by particular physical characteristics and security system uti.
Zanzucchi,Peter John; Moroney, III,Richard Morgan; Aceti,John Gregory; Pletcher,Timothy Allen; Burstyn,Herschel Clement, Method and imager for detecting the location of objects.
Eckes,Christian; Kefalea,Efthimia; Von Der Malsburg,Chrstoph; P철tzsch,Michael; Rinne,Michael; Triesch,Jochen; Vorbr체ggen,Jan C., Method for recognizing objects in digitized images.
Steinberg,Eran; Prilutsky,Yury; Corcoran,Peter; Bigioi,Petronel, Method of improving orientation and color balance of digital images using face detection information.
Brunelli Roberto,ITX ; Mich Ornella,ITX, Method of storing and retrieving images of people, for example, in photographic archives and for the construction of id.
Ogrinc Michael A. (San Francisco CA) Card Robert A. (Palo Alto CA) Burns Chris R. (Mountain View CA) Clarke Charles P. (Los Altos CA) Collier Ronda L. (Scotts Valley CA) Collins Kevin M. (San Mateo C, Real time video image processing system.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Bigioi,Petronel, Real-time face tracking in a digital image acquisition device.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Bigioi,Petronel, Real-time face tracking in a digital image acquisition device.
Corcoran,Peter; Steinberg,Eran; Petrescu,Stefan; Drimbarean,Alexandru; Nanu,Florin; Pososin,Alexei; Biglol,Petronel, Real-time face tracking in a digital image acquisition device.
Ianculescu,Mihai; Bigioi,Petronel; Gangea,Mihnea; Petrescu,Stefan; Corcoran,Peter; Steinberg,Eran, Real-time face tracking in a digital image acquisition device.
Steinberg,Eran; Corcoran,Peter; Bigioi,Petronel; Pososin,Alexei; Drimbarean,Alexandru; Nanu,Florin; Petrescu,Stefan, Real-time face tracking in a digital image acquisition device.
Bortolussi Jay F. ; Cusack ; Jr. Francis J. ; Ehn Dennis C. ; Kuzeja Thomas M. ; Saulnier Michael S., Real-time facial recognition and verification system.
Okubo,Atsushi; Sabe,Kohtaro; Kawamoto,Kenta; Fukuchi,Masaki, Robot device and face identifying method, and image identifying device and image identifying method.
Maeda Yutaka (Kanagawa JPX) Kyoden Yasuhiro (Sagamihara JPX) Naruto Hirokazu (Higashiosaka JPX) Tanaka Yoshito (Sakai JPX) Shintani Dai (Sakai JPX) Nanba Katsuyuki (Osakasayama JPX), Still video camera having a printer capable of printing a photographed image in a plurality of printing modes.
Mashimo Yukio (Tokyo JA) Sakurada Nobuaki (Kanagawa JA) Ito Tadashi (Kanagawa JA) Ito Fumio (Kanagawa JA) Shinoda Nobuhiko (Tokyo JA), System for exposure measurement and/or focus detection by means of image senser.
Mashimo Yukio (Tokyo JPX) Sakurada Nobuaki (Kanagawa JPX) Ito Tadashi (Kanagawa JPX) Ito Fumio (Kanagawa JPX) Shinoda Nobuhiko (Tokyo JPX), System for exposure measurement and/or focus detection by means of image sensor.
Freeman William T. ; Leventon Michael E., System for reconstructing the 3-dimensional motions of a human figure from a monocularly-viewed image sequence.
Kuperstein Michael ; Kottas James A., System, method and application for the recognition, verification and similarity ranking of facial or other object patterns.
Wheeler Richard B. (Webster NY), Technique suited for use in multi-zone autofocusing cameras for improving image quality for non-standard display sizes a.
Kojima Kazuaki (Nagaokakyo JPX) Kuno Tetsuya (Nagaokakyo JPX) Sugiura Hiroaki (Nagaokakyo JPX) Yamada Takeshi (Nagaokakyo JPX), Video signal processor for detecting flesh tones in am image.
Jain Ramesh ; Horowitz Bradley ; Fuller Charles E. ; Gupta Amarnath ; Bach Jeffrey R. ; Shu Chiao-fe, Visual image database search engine which allows for different schema.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas, Apparatus and methods for modifying keratinous surfaces.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas, Apparatus and methods for modifying keratinous surfaces.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas, Apparatus and methods for modifying keratinous surfaces.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas, Applicator heads for handheld treatment apparatus for modifying keratinous surfaces.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas; Striemer, Grant Edward Anders; Lingoes, Janette Villalobos; Kuhlman, Dennis Eugene, Cartridges for the deposition of treatment compositions on keratinous surfaces.
Rabe, Thomas Elliot; Sherman, Faiz Feisal; Bush, Stephan Gary; Meschkat, Stephan James Andreas, Handheld treatment apparatus for modifying keratinous surfaces.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.