[미국특허]
Utilizing a search scheme for screen content video coding
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-007/32
H04N-019/557
H04N-019/56
H04N-019/533
출원번호
US-0435199
(2012-03-30)
등록번호
US-9332271
(2016-05-03)
발명자
/ 주소
Chen, Sijia
Li, Kai
Liu, Wayne
Tao, Siping
출원인 / 주소
Cisco Technology, Inc.
대리인 / 주소
Edell, Shapiro & Finnan, LLC
인용정보
피인용 횟수 :
0인용 특허 :
4
초록▼
A method, a device and computer readable storage media facilitate providing screen content including a plurality of video frames that are displayed by a computing device. During coding of the screen content, a suitable predictor is found that is used to code pixel blocks from one or more frames. The
A method, a device and computer readable storage media facilitate providing screen content including a plurality of video frames that are displayed by a computing device. During coding of the screen content, a suitable predictor is found that is used to code pixel blocks from one or more frames. The suitable predictor is found by selecting a pixel block of a current frame, conducting a direction based search by comparing pixel blocks within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists, and, in response to a determination that no sufficient match has been found, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to find a suitable match based upon a common feature.
대표청구항▼
1. A method comprising: providing screen content comprising a plurality of video frames that are displayed by a computing device; andduring coding of the screen content, finding a suitable predictor that is used to code pixel blocks from one or more frames, wherein the finding of the suitable predic
1. A method comprising: providing screen content comprising a plurality of video frames that are displayed by a computing device; andduring coding of the screen content, finding a suitable predictor that is used to code pixel blocks from one or more frames, wherein the finding of the suitable predictor comprises: selecting a pixel block of a current frame;conducting a direction based search by comparing pixel blocks along at least one predetermined direction within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists between a pixel block of the reference frame and the selected pixel block of the current frame; andin response to a determination that no sufficient match has been found between any pixel block within the search window of the reference frame and the selected pixel block of the current frame from the direction based search, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to determine whether a match exists between any pixel block of the reference frame having a feature with a value that is within a predetermined range of a value of the same feature for the selected pixel block of the current frame, wherein conducting the feature oriented search further comprises:determining a sums of block (SD) value for pixel blocks within the reference frame, wherein each SD value for a pixel block of the reference frame comprises an absolute value of a difference between a sum of pixel values in the reference block and a sum of pixel values in the selected pixel block of the current frame, and each pixel value is a quantified value of a feature for the pixel associated with the pixel value; andordering the feature oriented search within the reference frame so as to compare pixel blocks of the reference frame having lower SD values with the selected pixel block of the current frame prior to comparing pixel blocks of the reference frame having higher SD values with the selected pixel block of the current frame. 2. The method of claim 1, further comprising: establishing a collaboration session between a first computing device and a second computing device, wherein the first computing device shares the screen content with the second computing device. 3. The method of claim 1, wherein the direction based search comprises a search along at least one predetermined directions within the search window of the reference frame. 4. The method of claim 1, wherein a match is determined to exist during the direction based search based upon a comparison of pixel values between a candidate pixel block of the reference frame and corresponding pixel values of the selected pixel block of the current frame, where a difference between pixel values of the candidate pixel block of the reference frame and the pixel block of the current frame falls within a predetermined range of values. 5. The method of claim 1, wherein each pixel value comprises a luminance value of the pixel associated with the pixel value. 6. The method of claim 1, wherein the feature oriented search is terminated when at least one pixel block of the reference frame is reached during the ordered search that has a SD value greater than a threshold value. 7. An apparatus comprising: a memory configured to store instructions including a predictor application; anda processor configured to execute and control operations of the predictor application so as to: find a suitable predictor that is used to code pixel blocks from one or more frames in a plurality of video frames of screen content that is displayed by the apparatus, wherein the finding of the suitable predictor comprises:selecting a pixel block of a current frame;conducting a direction based search by comparing pixel blocks along at least one predetermined direction within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists between a pixel block of the reference frame and the selected pixel block of the current frame; andin response to a determination that no sufficient match has been found between any pixel block within the search window of the reference frame and the selected pixel block of the current frame from the direction based search, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to determine whether a match exists between any pixel block of the reference frame having a feature with a value that is within a predetermined range of a value of the same feature for the selected pixel block of the current frame, wherein the processor is further configured to conduct the feature oriented search by: determining a sums of block (SD) value for pixel blocks within the reference frame, wherein each SD value for a pixel block of the reference frame comprises an absolute value of a difference between a sum of pixel values in the reference block and a sum of pixel values in the selected pixel block of the current frame, and each pixel value is a quantified value of a feature for the pixel associated with the pixel value; andordering the feature oriented search within the reference frame so as to compare pixel blocks of the reference frame having lower SD values with the selected pixel block of the current frame prior to comparing pixel blocks of the reference frame having higher SD values with the selected pixel block of the current frame. 8. The apparatus of claim 7, further comprising an interface unit configured to establish a collaboration session between the apparatus and a computing device, wherein the apparatus shares the screen content with the computing device. 9. The apparatus of claim 7, wherein the processor is further configured to search along at least two predetermined directions within the search window of the reference frame during the direction based search. 10. The apparatus of claim 7, wherein the processor is further configured to determine that a match exists during the direction based search based upon a comparison of pixel values between a candidate pixel block of the reference frame and corresponding pixel values of the selected pixel block of the current frame, where a difference between pixel values of the candidate pixel block of the reference frame and the pixel block of the current frame falls within a predetermined range of values. 11. The apparatus of claim 7, wherein each pixel value comprises a luminance value of the pixel associated with the pixel value. 12. The apparatus of claim 7, wherein the processor is further configured to terminate the feature oriented search when at least one pixel block of the reference frame is reached during the ordered search that has a SD value greater than a threshold value. 13. One or more computer readable storage devices encoded with software comprising computer executable instructions and when the software is executed operable to: find a suitable predictor that is used to code pixel blocks from one or more frames in a plurality of video frames of screen content that is displayed by a computing device, by: selecting a pixel block of a current frame;conducting a direction based search by comparing pixel blocks along at least one predetermined direction within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists between a pixel block of the reference frame and the selected pixel block of the current frame; andin response to a determination that no sufficient match has been found between any pixel block within the search window of the reference frame and the selected pixel block of the current frame from the direction based search, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to determine whether a match exists between any pixel block of the reference frame having a feature with a value that is within a predetermined range of a value of the same feature for the selected pixel block of the current frame, wherein the instructions are further operable to conduct the feature oriented search by: determining a sums of block (SD) value for pixel blocks within the reference frame, wherein each SD value for a pixel block of the reference frame comprises an absolute value of a difference between a sum of pixel values in the reference block and a sum of pixel values in the selected pixel block of the current frame, and each pixel value is a quantified value of a feature for the pixel associated with the pixel value; andordering the feature oriented search within the reference frame so as to compare pixel blocks of the reference frame having lower SD values with the selected pixel block of the current frame prior to comparing pixel blocks of the reference frame having higher SD values with the selected pixel block of the current frame. 14. The one or more computer readable storage devices of claim 13, and further comprising instructions that are operable to establish a collaboration session between a first computing device and a second computing device, wherein the first computing device shares screen content that is displayed by the first computing device with the second computing device. 15. The one or more computer readable storage devices of claim 13, and further comprising instructions that are operable to search along at least two predetermined directions within the search window of the reference frame during the direction based search. 16. The one or more computer readable storage devices of claim 13, and further comprising instructions that are operable to determine that a match exists during the direction based search based upon a comparison of pixel values between a candidate pixel block of the reference frame and corresponding pixel values of the selected pixel block of the current frame, where a difference between pixel values of the candidate pixel block of the reference frame and the pixel block of the current frame falls within a predetermined range of values. 17. The one or more computer readable storage devices of claim 13, wherein each pixel value comprises a luminance value of the pixel associated with the pixel value. 18. The one or more computer readable storage devices of claim 13, and further comprising instructions that are operable to terminate the feature oriented search when at least one pixel block of the reference frame is reached during the ordered search that has a SD value greater than a threshold value.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.