IPC분류정보
국가/구분 |
United States(US) Patent
등록
|
국제특허분류(IPC7판) |
|
출원번호 |
UP-0061734
(2005-02-22)
|
등록번호 |
US-7526142
(2009-07-01)
|
발명자
/ 주소 |
- Sheraizin, Vitaly S.
- Sheraizin, Semion M.
|
인용정보 |
피인용 횟수 :
7 인용 특허 :
96 |
초록
▼
A method and apparatus for enhancing the video quality of compressed video signals adaptively removes distortions and ringing effects embedded in the decompressed images. The apparatus operates in conjunction with decoder devices installed in set-top boxes, satellite receivers, TV broadcast channel
A method and apparatus for enhancing the video quality of compressed video signals adaptively removes distortions and ringing effects embedded in the decompressed images. The apparatus operates in conjunction with decoder devices installed in set-top boxes, satellite receivers, TV broadcast channel servers, digital still cameras, DVD players and recorders, large screen TV sets, media players, and the like.
대표청구항
▼
What is claimed is: 1. An apparatus comprising: an estimation unit to generate visual quality parameters that indicate visual quality of decompressed video frames; and a decompressed video enhancer to improve the visual quality of said decompressed video frames using said visual quality parameters,
What is claimed is: 1. An apparatus comprising: an estimation unit to generate visual quality parameters that indicate visual quality of decompressed video frames; and a decompressed video enhancer to improve the visual quality of said decompressed video frames using said visual quality parameters, wherein said estimation unit comprises: a distortion estimator to estimate a distortion level DR in individual decompressed video frames; a parameter estimator to estimate an image complexity value NC and a per pixel intensity change hij; and a high contrast details analyzer to estimate high contrast small details levels CHi,j in individual decompressed video frames. 2. The apparatus of claim 1, wherein said distortion estimator comprises a blockness level determiner. 3. The apparatus of claim 2, wherein said blockness level determiner comprises: an into line integrator to sum high frequency components in every k pixels along a line of individual decompressed video frames; and a line-to-line periodicity detector to sum the output of said line integrator every kth line, starting at different lines and to sum those blocks which are distorted. 4. The apparatus of claim 1, wherein said parameter estimator comprises: an intensity change generator to generate per-pixel intensity change value hi,j; and an image complexity generator to determine per-frame image complexity level NC. 5. The apparatus of claim 4, wherein said intensity change generator comprises: a first frame memory to generate a difference frame of an individual decompressed video frame and a previous individual decompressed video frame; an absolute value unit to take an absolute value of said difference frame ΔF; and a horizontal low pass filter (LPF) to reduce noise in the output of said absolute value unit. 6. The apparatus of claim 4, wherein said image complexity generator comprises: a histogram difference generator to determine how different a histogram of the intensities of an individual decompressed video frame is from that of a previous individual decompressed video frame; a frame intensity change generator to determine an overall change value from said per-pixel intensity changes hi,j, said overall change value indicating the extent of significant change in said individual decompressed video frames; and an image complexity generator to generate said per-frame image complexity level NC from a weighted sum of the outputs of said generators. 7. The apparatus of claim 1, wherein said high contrast details analyzer comprises: a shifter to shift high frequency components of an individual decompressed video frame downward by a first threshold THD1, wherein said first threshold THD1 is defined by expected intensity levels of high contrast details; a first limiter to limit high frequency components of said decompressed individual video frame to an intensity level below a second threshold; a two-dimensional low pass filter operating on output of said first limiter to detect dots in said decompressed individual video frame; and a second limiter to limit output of said two-dimensional low pass filter to an intensity level below a third threshold. 8. The apparatus of claim 1, wherein said enhancer comprises: an adaptive temporal processor to adapt temporal processing of individual decompressed video frame with at least one of said visual quality parameters; and an adaptive spatial processor to adapt spatial processing of output of said adaptive temporal processor with at least one of said visual quality parameters. 9. The apparatus of claim 8, further comprising a controller to generate at least temporal control parameters for said adaptive temporal processor and spatial-temporal control parameters for said adaptive spatial processor from at least one of said visual quality parameters. 10. The apparatus of claim 9, wherein said temporal control parameters comprise at least one of: a temporal threshold THDTP determined by: THDTP=2[(1+DR*)+(1+NC)]; a temporal texture coefficient KTPtext determined by: KtextTP=1-DR*; a temporal contrast coefficient KTPcont determined by: KcontTP=1-DR*; and a low frequency coefficient KF determined by: KF=1-0.5DR*, wherein said DR* is a normalized value of said distortion level DR. 11. The apparatus of claim 10, wherein said adaptive temporal processor comprises: a temporal processor to temporally process said individual decompressed video frames; a texture improver to receive vertical and horizontal high pass filtered signals from said temporal processor and to attempt to sharpen textual elements in said individual decompressed frames therefrom; a small details sharpener to adjust a sharpness of small details in said individual decompressed frames; and a distortion reducer to reduce blockness in said individual decompressed frames by attenuating low frequency components of said individual decompressed frames received from said temporal processor. 12. The apparatus of claim 11, wherein said texture improver comprises: a first limiter to limit an input signal level below said temporal threshold THDTP, wherein the input signal includes vertical high frequency components of said individual decompressed frames; a second limiter to limit an input signal level below said temporal threshold THDTP, wherein the input signal includes horizontal high frequency components of said individual decompressed frames; a horizontal low pass filter (LPF) to pass low frequency components of a signal produced by said first limiter; a vertical LPF to pass low frequency components of a signal produced by said second limiter; and a texture sharpener to adjust texture sharpness of a sum of the outputs of said LPF according to said temporal texture coefficient KTPtext. 13. The apparatus of claim 12, wherein said small details sharpener comprises: a small details unit to generate a small details signal from said vertical and horizontal high frequency components and outputs of said limiters; and a small details sharpener to adjust a sharpness of said small details signal according to said temporal contrast coefficient KTPcont. 14. The apparatus of claim 11, wherein said distortion reducer comprises a blockness sharpener to reduce a level of low frequency components of said individual decompressed video frames according to said low frequency coefficient KF. 15. The apparatus of claim 9, wherein said spatial-temporal control parameters comprise at least one of: a spatial-temporal threshold THDSP determined by: THDSP=3(1+DR*), a per-pixel, recursion coefficient Krec(i,j) determined by: Krec(i,j)=Krec.o[1+0.25(DR*+CHi,j*)]; a per-pixel ringing coefficient Kring(i,j) determined by: Kring(i,j)=1-0.5 hij*, a spatial-temporal texture coefficient KSPtext determined by: KtextSP=Ktext.o(1-DR*); and a per-pixel, spatial-temporal contrast coefficient KSPcont(i,j) determined by KcontSP(i,j)=Kcont.o[1-0.5(DR*-CHi,j*) ], wherein said DR* is a normalized value of said distortion level DR, said CHi,j* are normalized values of said CHi,j values and said hij* are normalized values of said hij, and wherein said Kcont.o is a maximum contrast coefficient, said Krec.o is a maximum recursion coefficient, or said Ktext.o is a maximum texture coefficient. 16. The apparatus of claim 15, wherein said per-pixel, ringing coefficient Kring(i,j) is used to reduce ringing effects in at least one of said individual decompressed video frames. 17. The apparatus of claim 15, wherein said adaptive spatial processor comprises: a spatial-temporal processor to perform spatial processing on individual decompressed video frames; a texture improver to adjust textual elements in said individual decompressed video frames; a small details sharpener to adjust a sharpness of small details in said individual decompressed video frames; and a ringing reducer to receive vertical and horizontal high pass filtered signals from said spatial-temporal processor and to reduce ringing effects in said individual decompressed video frames. 18. The apparatus of claim 17, wherein said ringing reducer comprises: a first limiter to limit an input signal level below said spatial-temporal threshold THDSP, wherein the input signal includes vertical high frequency components of said individual decompressed video frames; a second limiter to limit an input signal level below said spatial-temporal threshold THDSP, wherein the input signal includes horizontal high frequency components of said individual decompressed video frames; a vertical anti-ringing unit to reduce ringing effects in said vertical high pass filtered signals according to said ringing coefficient Kring(i,j); and a horizontal anti-ringing to reduce ringing effects in said vertical high pass filtered signals according to said ringing coefficient Kring(i,j). 19. The apparatus of claim 17 wherein said small details sharpener comprises a high contrast sharpener to adjust a sharpness of said small details signal according to said spatial-temporal contrast coefficient KSPcont(i,j). 20. The apparatus of claim 17, wherein said texture improver comprises: a temporal low pass filter (LPF) to reduce noise according to said recursion coefficient Krec; and a texture sharpener to adjust texture sharpness of an output of said temporal LPF according to a value of said spatial-temporal texture coefficient KSPtext. 21. The apparatus of claim 8, wherein said adaptive temporal processor comprises an infinite impulse response (IIR) filter to use an adaptive recursion coefficient determined at least from said estimated distortion level DR. 22. A method comprising: estimating, using at least one of one or more processors, visual quality parameters that indicate visual quality of decompressed video frames; and improving, using at least one of the one or more processors, the visual quality of said decompressed video frames using said visual quality parameters, wherein said estimating comprises estimating a distortion level DR in individual decompressed video frames, an image complexity value NC, a per pixel intensity change hij and a high contrast small details level CH in individual decompressed video frames. 23. The method of claim 22, wherein said estimating comprises determining a blockness level. 24. The method of claim 23, wherein said determining comprises: summing high frequency components in every k pixels along a line of an individual decompressed video frame; and detecting line-to-line periodicity by summing the output of said high frequency summing every kth line, starting at different lines and by summing those blocks which are distorted. 25. The method of claim 22, wherein said estimating comprises: generating a per-pixel intensity change hi,j; and determining a per-frame image complexity level NC. 26. The method according to claim 25, wherein said generating comprises: subtracting an individual decompressed video frame and a previous individual decompressed video frame to generate a difference frame ΔF; taking an absolute value of said difference frame ΔF; and horizontally low pass filtering to reduce noise in the output of said absolute value unit. 27. The method according to claim 25, wherein said determining comprises: subtracting, using at least one of the one or more processors, a histogram of the intensities of an individual decompressed video frame from that of a previous individual decompressed video frame; generating, using at least one of the one or more processors, an overall change value from said per-pixel intensity changes hij, said overall change value indicating the extent of significant change in said individual decompressed video frame; and weighted summing, using at least one of the one or more processors, the outputs of said subtracting to generate said per-frame image complexity level NC. 28. The method of claim 22, wherein said estimating comprises: shifting said frequency components of an individual decompressed video frame downward by a first threshold THD1, wherein said first threshold THD1 is defined by expected intensity levels of high contrast details; limiting high frequency components of said individual decompressed video frame to an intensity level below a second threshold; two-dimensional low pass filtering the output of said limiting to detect dots in said individual decompressed video frame; and limiting the output of said two-dimensional low pass filter to an intensity level below a third threshold. 29. The method of claim 22, wherein said improving comprises: temporally adapting processing of individual decompressed video frames with at least one of said visual quality parameters; and spatially adapting processing of output of said temporal adapting with at least one of said visual quality parameters. 30. The method of claim 29, further comprising generating at least temporal control parameters and spatial-temporal control parameters from at least one of said visual quality parameters. 31. The method of claim 30, wherein said temporal control parameters comprise at least one of: a temporal threshold THDTP determined by: THDTP=2[(1+DR*)+(1+NC)]; a temporal texture coefficient KTPtext determined by: KtextTP=1-DR*; a temporal contrast coefficient KTPcont determined by: KcontTP=1-DR*; and a low frequency coefficient KF determined by: KF=1-0.5DR*, wherein said DR* is a normalized value of said distortion level DR. 32. The method of claim 31, wherein said temporally adapting comprises: temporally processing said individual decompressed video frames; first adjusting the sharpness of textual elements in said individual decompressed video frames; second adjusting a sharpness of small details in said individual decompressed video frames; and reducing blockness in said frame by attenuating low frequency components of said individual decompressed video frames received from said temporal processing. 33. The method of claim 32, wherein said first adjusting comprises: first limiting, using at least one of the one or more processors, an input signal level below said temporal threshold THDTP, wherein the input signal includes vertical high frequency components of said decompressed frame; second limiting, using at least one of the one or more processors, an input signal level below said temporal threshold THDTP, wherein the input signal includes horizontal high frequency components of said decompressed frame; horizontal low pass filtering, using at least one of the one or more processors, of a signal produced by said first limiting; vertical low pass filtering, using at least one of the one or more processors, of a signal produced by said second limiting; and adjusting texture sharpness, using at least one of the one or more processors, of the sum of the outputs of said filtering steps according to said temporal texture coefficient KTPtext. 34. The method of claim 33, wherein said adjusting comprises: generating a small details signal from said vertical and horizontal high frequency components and outputs of said steps of limiting; and adjusting a sharpness of said small details signal according to said temporal contrast coefficient KTPcont. 35. The method of claim 32, wherein said reducing blockness comprises reducing a level of low frequency components of said decompressed video frame according to said low frequency coefficient KF. 36. The method of claim 30, wherein said spatial-temporal control parameters comprise at least one of: a spatial-temporal threshold THDSP determined by: THDSP=3(1+DR*); a per-pixel, recursion coefficient Krec(i,j) determined by: Krec(i,j)=Krec.o[1+0.25(DR*+CHi,j*)]; a per-pixel ringing coefficient Kring(i,j) determined by: Kring(i,j)=1-0.5 hij*; a spatial-temporal texture coefficient KSPtext determined by: KtextSP=Ktext.o(1-DR*); and a per-pixel, spatial-temporal contrast coefficient KSPcont(i,j) determined by KcontSP(i,j)=Kcont.o[1-0.5(DR*-CHi,j*) ], wherein said DR* is a normalized value of said distortion level DR, said CHi,j* are normalized values of said CHi,j values and said hij* are normalized values of said hij, and wherein said Kcont.o is a maximum contrast coefficient, said Krec.o is a maximum recursion coefficient, and said Ktext.o is a maximum texture coefficient. 37. The method of claim 36, further comprising using said per-pixel, ringing coefficient Kring(i,j) to reduce ringing effects in said individual decompressed video frames. 38. The method of claim 36, wherein said spatially adapting comprises: performing spatial processing on said individual decompressed video frames; adjusting textual elements in said individual decompressed video frames; sharpening small details in said individual decompressed video frames; and reducing ringing effects in said individual decompressed video frames. 39. The method of claim 38, wherein said reducing comprises: first limiting an input signal level below said spatial-temporal threshold THDSP, wherein the input signal includes vertical high frequency components of said decompressed frame; second limiting an input signal level below said spatial-temporal threshold THDSP, wherein the input signal includes horizontal high frequency components of said decompressed frame; and reducing ringing effects in high pass filtered signals according to said ringing coefficient Kring(i,j). 40. The method of claim 38, wherein said sharpening comprises adjusting a sharpness of said small details signal according to said spatial-temporal contrast coefficient KSPcont(i,j). 41. The method of claim 38, wherein said adjusting comprises: a temporally low pass filtering to reduce noise according to said recursion coefficient Krec; and adjusting texture sharpness of output of said filtering according to a value of said spatial-temporal texture coefficient KSPtext. 42. The method of claim 29, wherein said temporally adapting comprises an infinite impulse response (IIR) filtering using an adaptive recursion coefficient determined at least from said estimated distortion level DR. 43. A computer-readable storage medium embodying computer-readable instructions which, when executed, implement a method comprising: estimating visual quality parameters that indicate visual quality of decompressed video frames; and improving the visual quality of said decompressed video frames using one or more of said visual quality parameters, wherein said estimating comprises-estimating a distortion level DR in individual decompressed video frames, an image complexity value NC, a per pixel intensity change hij and a high contrast small details level CH in individual decompressed video frames. 44. A computer-readable storage media embodying computer-readable instructions of claim 43, wherein said estimating comprises determining a blockness level. 45. A computer-readable storage media embodying computer-readable instructions of claim 43, wherein said estimating comprises: generating the per-pixel intensity change hij; and determining the per-frame image complexity level NC. 46. A computer-readable storage media embodying computer-readable instructions of claim 43, wherein said improving comprises: temporally adapting processing of said decompressed video frame with at least one of said visual quality parameters; and spatially adapting processing of output of said temporal adapting with at least one of said visual quality parameters. 47. A computer-readable storage media embodying computer-readable instructions of claim 46, wherein said temporally adapting comprises: temporally processing said decompressed video frames; first adjusting sharpness of textual elements in said decompressed video frames; second adjusting sharpness of small details in said decompressed video frames; and reducing blockness in said decompressed video frames by attenuating low frequency components of said decompressed video frames received from said temporal processing. 48. A computer-readable storage media embodying computer-readable instructions of claim 46, wherein said spatially adapting comprises: performing spatial processing on said decompressed video frames; adjusting textual elements in said decompressed video frames; sharpening small details in said decompressed video frames; and reducing ringing effects in said decompressed video frames. 49. A computer-readable storage media embodying computer-readable instructions of claim 46, wherein said temporally adapting comprises an infinite impulse response (IIR) filtering using an adaptive recursion coefficient determined at least from said estimated distortion level DR.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.