Tone mapping for low-light video frame enhancement
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-009/64
G06T-005/50
H04N-009/68
G06T-005/00
출원번호
US-0012806
(2013-08-28)
등록번호
US-8890983
(2014-11-18)
발명자
/ 주소
Vranceanu, Ruxandra
출원인 / 주소
DigitalOptics Corporation Europe Limited
대리인 / 주소
Hickman Palermo Truong Becker Bingham Wong LLP
인용정보
피인용 횟수 :
0인용 특허 :
12
초록▼
A technique is provided for generating sharp, well-exposed, color images from low-light images. A series of under-exposed images is acquired. A mean image is computed and a sum image is generated each based on the series of under-exposed images. Chrominance variables of pixels of the mean image are
A technique is provided for generating sharp, well-exposed, color images from low-light images. A series of under-exposed images is acquired. A mean image is computed and a sum image is generated each based on the series of under-exposed images. Chrominance variables of pixels of the mean image are mapped to chrominance variables of pixels of the sum image. Chrominance values of pixels within the series of under-exposed images are replaced with chrominance values of the sum image. A set of sharp, well-exposed, color images is generated based on the series of under-exposed images with replaced chrominance values.
대표청구항▼
1. An image processing method comprising; obtaining a first underexposed and sharp image of a scene;obtaining a second image relatively well exposed and blurred compared to said first image, nominally of the same scene, wherein said second image is acquired at a different exposure time than said fir
1. An image processing method comprising; obtaining a first underexposed and sharp image of a scene;obtaining a second image relatively well exposed and blurred compared to said first image, nominally of the same scene, wherein said second image is acquired at a different exposure time than said first image;scanning across said first and second images to: provide a portion of said first image as an input signal to an adaptive filter;provide a corresponding portion of said second image as a desired signal to said adaptive filter; andcalculate filter coefficients for said portion of said images at a given scanning location based on a combination of said input signal, said desired signal and existing filter coefficients for said scanning location; andadaptively filter said input signal based on said filter coefficients to produce an output signal and constructing a first filtered image from said output signal, less blurred than said second image. 2. An image processing method according to claim 1, wherein said first and second images being in RGB format and wherein said image portions comprise a respective color plane of said first and second images and further comprising constructing each color plane of said first filtered image from a combination of said filter coefficients and said input signal color plane information. 3. An image processing method according to claim 1, wherein said first and second images being in YCC format, wherein said image portions comprise a respective Y plane of said first and second images, and wherein said constructing said first filtered image comprises using said output signal as a Y plane of said first filtered image and using Cb and Cr planes of said input image as the Cb and Cr planes of said first filtered image. 4. An image processing method according to claim 1, further comprising: providing a portion of said first filtered image as said input signal to an adaptive filter;providing a corresponding portion of said second image as a desired signal to said adaptive filter;further adaptively filtering said input signal to produce a further output signal; andconstructing a further filtered image from said further output signal less blurred than said first filtered image. 5. An image processing method according to claim 4, wherein: said first and second images being in RGB format and, for producing said first filtered image, said image portions comprise a respective color plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to YCC format;said method further comprises converting said second image to YCC format; andwherein said image portions for further adaptive filtering comprise a respective Y plane of said converted images. 6. An image processing method according to claim 4 wherein: said first and second images being in YCC format and, for producing said first filtered image, said image portions comprise a respective Y plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to RGB format;said method further comprises converting said second image to RGB format; andwherein said image portions for further adaptive filtering comprise a respective color plane of said converted images. 7. An image processing method according to claim 4 wherein said adaptively filtering being performed row-wise or column-wise on said input signal and wherein further adaptive filtering is performed on the other of row-wise or column wise on said input signal. 8. An image processing method according to claim 1, wherein said image source for said second image comprises relatively higher resolution than said image source for said first image. 9. An image processing method as claimed in claim 8, further comprising: prior to adaptive filtering, estimating a point spread function, PSF, for said second image; andresponsive to said PSF being less than a pre-determined threshold, de-blurring said second image with said point spread function. 10. An image processing method according to claim 8 further comprising amplifying the luminance characteristics of said under exposed image prior to said adaptively filtering. 11. An image processing method according to claim 8 wherein said first image comprising one of an image acquired soon before or after said second image. 12. An image processing method according to claim 1 wherein said image source for said second image comprises relatively lower resolution than said image source for said first image. 13. An image processing method according to claim 12 further comprising: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a predetermined threshold, providing said desired signal from a linear combination of said first and second image sources. 14. An image processing method according to claim 12 further comprising: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a pre-determined threshold, providing said desired signal from a combination of phase values from one of said first and second image sources and amplitude values for the other of said first and second image sources. 15. An image processing method according to claim 1, wherein said first and second images being derived from respective image sources. 16. An image processing method according to claim 1, wherein said second image being acquired at a different resolution than said first image. 17. A digital video acquisition and processing device, comprising: a lens and an image sensor for capturing a stream of multiple digital video or still images;a processor; anda memory having processor-readable code embedded therein for programming the processor to perform a method of generating sharp, well-exposed, color images from under-exposed, low-light images, wherein the method comprises: obtaining a first underexposed and sharp image of a scene;obtaining a second image relatively well exposed and blurred compared to said first image, nominally of the same scene, wherein said second image is acquired at a different exposure time than said first image;scanning across said first and second images to: provide a portion of said first image as an input signal to an adaptive filter;provide a corresponding portion of said second image as a desired signal to said adaptive filter; andcalculate filter coefficients for said portion of said images at a given scanning location based on a combination of said input signal, said desired signal and existing filter coefficients for said scanning location; andadaptively filter said input signal based on said filter coefficients to produce an output signal and constructing a first filtered image from said output signal, less blurred than said second image. 18. An image processing device according to claim 17, wherein said first and second images being in RGB format and wherein said image portions comprise a respective color plane of said first and second images and further comprising constructing each color plane of said first filtered image from a combination of said filter coefficients and said input signal color plane information. 19. An image processing device according to claim 17, wherein said first and second images being in YCC format, wherein said image portions comprise a respective Y plane of said first and second images, and wherein said constructing said first filtered image comprises using said output signal as a Y plane of said first filtered image and using Cb and Cr planes of said input image as the Cb and Cr planes of said first filtered image. 20. An image processing device according to claim 17, wherein the method further comprises: providing a portion of said first filtered image as said input signal to an adaptive filter;providing a corresponding portion of said second image as a desired signal to said adaptive filter;further adaptively filtering said input signal to produce a further output signal; andconstructing a further filtered image from said further output signal less blurred than said first filtered image. 21. An image processing device according to claim 20, wherein: said first and second images being in RGB format and, for producing said first filtered image, said image portions comprise a respective color plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to YCC format;said method further comprises converting said second image to YCC format; andwherein said image portions for further adaptive filtering comprise a respective Y plane of said converted images. 22. An image processing device according to claim 20 wherein: said first and second images being in YCC format and, for producing said first filtered image, said image portions comprise a respective Y plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to RGB format;said method further comprises converting said second image to RGB format; andwherein said image portions for further adaptive filtering comprise a respective color plane of said converted images. 23. An image processing device according to claim 20 wherein said adaptively filtering being performed row-wise or column-wise on said input signal and wherein further adaptive filtering is performed on the other of row-wise or column wise on said input signal. 24. An image processing device according to claim 17, wherein said image source for said second image comprises relatively higher resolution than said image source for said first image. 25. An image processing device as claimed in claim 24, wherein the method further comprises: prior to adaptive filtering, estimating a point spread function, PSF, for said second image; andresponsive to said PSF being less than a pre-determined threshold, de-blurring said second image with said point spread function. 26. An image processing device according to claim 24 wherein the method further comprises amplifying the luminance characteristics of said under exposed image prior to said adaptively filtering. 27. An image processing device according to claim 24 wherein said first image comprising one of an image acquired soon before or after said second image. 28. An image processing device according to claim 17 wherein said image source for said second image comprises relatively lower resolution than said image source for said first image. 29. An image processing device according to claim 28 wherein the method further comprises: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a predetermined threshold, providing said desired signal from a linear combination of said first and second image sources. 30. An image processing device according to claim 28 wherein the method further comprises: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a pre-determined threshold, providing said desired signal from a combination of phase values from one of said first and second image sources and amplitude values for the other of said first and second image sources. 31. An image processing device according to claim 17, wherein said first and second images being derived from respective image sources. 32. An image processing device according to claim 17, wherein said second image being acquired at a different resolution than said first image. 33. One or more non-transitory processor-readable media having code embedded therein for programming one or more processors to perform a method of generating sharp, well-exposed, color images from under-exposed, low-light images, wherein the method comprises: obtaining a first underexposed and sharp image of a scene;obtaining a second image relatively well exposed and blurred compared to said first image, nominally of the same scene, wherein said second image is acquired at a different exposure time than said first image;scanning across said first and second images to: provide a portion of said first image as an input signal to an adaptive filter;provide a corresponding portion of said second image as a desired signal to said adaptive filter; andcalculate filter coefficients for said portion of said images at a given scanning location based on a combination of said input signal, said desired signal and existing filter coefficients for said scanning location; andadaptively filter said input signal based on said filter coefficients to produce an output signal and constructing a first filtered image from said output signal, less blurred than said second image. 34. One of more non-transitory processor-readable media according to claim 33, wherein said first and second images being in RGB format and wherein said image portions comprise a respective color plane of said first and second images and further comprising constructing each color plane of said first filtered image from a combination of said filter coefficients and said input signal color plane information. 35. One of more non-transitory processor-readable media according to claim 33, wherein said first and second images being in YCC format, wherein said image portions comprise a respective Y plane of said first and second images, and wherein said constructing said first filtered image comprises using said output signal as a Y plane of said first filtered image and using Cb and Cr planes of said input image as the Cb and Cr planes of said first filtered image. 36. One of more non-transitory processor-readable media according to claim 33, wherein the method further comprises: providing a portion of said first filtered image as said input signal to an adaptive filter;providing a corresponding portion of said second image as a desired signal to said adaptive filter;further adaptively filtering said input signal to produce a further output signal; andconstructing a further filtered image from said further output signal less blurred than said first filtered image. 37. One of more non-transitory processor-readable media according to claim 36, wherein: said first and second images being in RGB format and, for producing said first filtered image, said image portions comprise a respective color plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to YCC format;said method further comprises converting said second image to YCC format; andwherein said image portions for further adaptive filtering comprise a respective Y plane of said converted images. 38. One of more non-transitory processor-readable media according to claim 36 wherein: said first and second images being in YCC format and, for producing said first filtered image, said image portions comprise a respective Y plane of said first and second images;said providing a portion of said first filtered image comprises converting said first filtered image to RGB format;said method further comprises converting said second image to RGB format; andwherein said image portions for further adaptive filtering comprise a respective color plane of said converted images. 39. One of more non-transitory processor-readable media according to claim 36 wherein said adaptively filtering being performed row-wise or column-wise on said input signal and wherein further adaptive filtering is performed on the other of row-wise or column wise on said input signal. 40. One of more non-transitory processor-readable media according to claim 33, wherein said image source for said second image comprises relatively higher resolution than said image source for said first image. 41. One of more non-transitory processor-readable media as claimed in claim 40, wherein the method further comprises: prior to adaptive filtering, estimating a point spread function, PSF, for said second image; andresponsive to said PSF being less than a pre-determined threshold, de-blurring said second image with said point spread function. 42. One of more non-transitory processor-readable media according to claim 40 wherein the method further comprises amplifying the luminance characteristics of said under exposed image prior to said adaptively filtering. 43. One of more non-transitory processor-readable media according to claim 40 wherein said first image comprising one of an image acquired soon before or after said second image. 44. One of more non-transitory processor-readable media according to claim 33 wherein said image source for said second image comprises relatively lower resolution than said image source for said first image. 45. One of more non-transitory processor-readable media according to claim 44 wherein the method further comprises: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a predetermined threshold, providing said desired signal from a linear combination of said first and second image sources. 46. One of more non-transitory processor-readable media according to claim 44 wherein the method further comprises: aligning and interpolating said second source to match the alignment and resolution of said first source andresponsive to said first and second sources being misaligned by more than a pre-determined threshold, providing said desired signal from a combination of phase values from one of said first and second image sources and amplitude values for the other of said first and second image sources. 47. One of more non-transitory processor-readable media according to claim 33, wherein said first and second images being derived from respective image sources. 48. One of more non-transitory processor-readable media according to claim 33, wherein said second image being acquired at a different resolution than said first image.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (12)
Covell,Michele M., Adaptive filtering of visual image using auxiliary image information.
Kim, Hyoung Jung; Lee, In Sung; Kim, Jong Hark; Park, Man Ho; Yoon, Byung Sik; Choi, Song In; Kim, Dae Sik, Harmonic-noise speech coding algorithm and coder using cepstrum analysis method.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.