IPC분류정보
국가/구분 |
United States(US) Patent
등록
|
국제특허분류(IPC7판) |
|
출원번호 |
US-0660257
(2012-10-25)
|
등록번호 |
US-8811764
(2014-08-19)
|
발명자
/ 주소 |
|
출원인 / 주소 |
|
대리인 / 주소 |
|
인용정보 |
피인용 횟수 :
3 인용 특허 :
5 |
초록
▼
Systems and methods for generating a composite image from a plurality of source images using a scene dependent multi-band blending operation are provided. The multi-band blending operation implements a filtering operation to reduce blending between objects or surfaces that have natural color and/or
Systems and methods for generating a composite image from a plurality of source images using a scene dependent multi-band blending operation are provided. The multi-band blending operation implements a filtering operation to reduce blending between objects or surfaces that have natural color and/or brightness differences. More particularly, the typical space invariant upsampling that occurs during multi-band blending can be replaced by a scene dependent filtering operation during upsampling that omits or reduces contributions from pixels associated with different objects in a scene during the multi-band blending process. The scene dependent filtering can be based on scene dependent data, such as height data or slope data, which can be used to identify different objects in a scene.
대표청구항
▼
1. A computer-implemented method of blending a plurality of source images, comprising: obtaining, with a computing device, a plurality of source images depicting a scene, each of the plurality of source images comprising a plurality of pixels;accessing scene-dependent data associated with the plural
1. A computer-implemented method of blending a plurality of source images, comprising: obtaining, with a computing device, a plurality of source images depicting a scene, each of the plurality of source images comprising a plurality of pixels;accessing scene-dependent data associated with the plurality of source images; andperforming, with the computing device, a multi-band blending operation to generate a composite image from the plurality of source images, the multi-band blending operation implementing a filtering operation based on the scene dependent data to modify blending of pixels located at a boundary between the plurality of source images. 2. The computer-implemented method of claim 1, wherein the scene dependent data comprises elevation data, slope data, or object identity data. 3. The computer-implemented method of claim 1, wherein the filtering operation reduces multi-band blending between pixels associated with objects of different elevation located at the boundary between the plurality of source images. 4. The computer-implemented method of claim 1, wherein the filtering operation reduces multi-band blending between pixels associated with a first object depicted in a first source image and pixels associated with a second object depicted in a second source image. 5. The computer-implemented method of claim 1, wherein the source images are geographic images depicting a geographic area. 6. The computer-implemented method of claim 5, wherein the composite image is texture mapped to a three-dimensional surface to provide a three-dimensional representation of a geographic area. 7. The computer-implemented method of claim 1, wherein performing the multi-band blending operation to generate the composite image comprises: constructing a first Gaussian pyramid for a first source image and a second Gaussian pyramid for at least one second source image;converting the first and second Gaussian pyramids into first and second Laplacian pyramids;generating a composite Laplacian pyramid from the first and second Laplacian pyramids;reconstructing a composite Gaussian pyramid from the composite Laplacian pyramid, the composite Gaussian pyramid having a plurality of levels including a base level and a plurality of higher levels associated with progressively lower levels of resolution, each level having one or more Gaussian pixels having a reconstructed Gaussian pixel value; andextracting the composite image from the base level of the composite Gaussian pyramid. 8. The computer-implemented method of claim 7, wherein the multi-band blending operation implements the filtering operation during reconstruction of the composite Gaussian pyramid. 9. The computer-implemented method of claim 8, wherein the filtering operation reduces the combining of pixel values associated with objects of different elevation during calculation of reconstructed Gaussian pixel values for Gaussian pixels in the composite Gaussian pyramid. 10. The computer-implemented method of claim 8, wherein the filtering operation reduces the combining of pixel values associated with different objects depicted in the scene during calculation of reconstructed Gaussian pixel values for Gaussian pixels in the composite Gaussian pyramid. 11. The computer-implemented method of claim 7, wherein the multi-band blending operation is implemented using a dual pyramid data structure, the dual pyramid data structure having a plurality of nodes, one or more of the plurality of nodes having a payload providing a first Gaussian pixel value computed from the first source image and a second Gaussian pixel value computed from the second source image. 12. The computer-implemented method of claim 11, wherein the filtering operation uses, based on the scene dependent data, one of the first Gaussian pixel value or the second Gaussian pixel value in computing a reconstructed Gaussian pixel value for a Gaussian pixel in the composite Gaussian pyramid. 13. A computing device configured to generate a composite image from a plurality of source images, the computing device having one or more processors and at least one memory, the at least one memory storing non-transitory computer-readable instructions for execution by the one or more processors to cause the one or more processors to perform operations, the operations comprising: obtaining a first source image and at least one second source image;generating a first Gaussian pyramid for the first source image and a second Gaussian pyramid for the at least one second source image;converting the first Gaussian pyramid into a first Laplacian pyramid and the second Gaussian pyramid into a second Laplacian pyramid;generating a composite Laplacian pyramid from the first and second Laplacian pyramids;reconstructing a composite Gaussian pyramid from the composite Laplacian pyramid, the composite Gaussian pyramid having a plurality of levels including a base level and a plurality of higher levels associated with progressively lower levels of resolution, each level having one or more Gaussian pixels having a reconstructed Gaussian pixel value; andextracting the composite image from the base level of the composite Gaussian pyramid;wherein the operation of reconstructing a composite Gaussian pyramid implements a scene dependent filtering operation to adjust the combining of pixel values during calculation of reconstructed Gaussian pixel values for Gaussian pixels in the composite Gaussian pyramid. 14. The computing device of claim 13, wherein the scene dependent filtering operation reduces the combining of pixel values associated with objects of different elevation or slope during calculation of reconstructed Gaussian pixel values for Gaussian pixels in the composite Gaussian pyramid. 15. The computing device of claim 13, wherein the scene dependent filtering operation reduces the combining of pixel values associated with different objects during calculation of reconstructed Gaussian pixel values for Gaussian pixels in the composite Gaussian pyramid. 16. The computing device of claim 13, wherein the scene dependent filtering operation calculates a reconstructed Gaussian pixel value for a first Gaussian pixel in the composite Gaussian pyramid based at least in part on a pixel value associated with a second Gaussian pixel in a next higher level of the composite Gaussian pyramid, the first Gaussian pixel being associated with a spatial location corresponding to the first source image and the second Gaussian pixel associated with a spatial location corresponding to the second source image. 17. The computing device of claim 16, wherein the pixel value associated with the second Gaussian pixel used in the calculation of the reconstructed Gaussian pixel value for the first Gaussian pixel is a projected Gaussian pixel value computed from the first source image. 18. The computing device of claim 13, wherein reconstructing the composite Gaussian pyramid is implemented using a dual pyramid data structure, the dual pyramid data structure having a plurality of nodes, one or more of the plurality of nodes having a payload providing a first Gaussian pixel value computed from the first source image and second Gaussian pixel value computed from the second source image. 19. A computer-readable medium encoded with a pyramid data structure for storing data used in generating a composite image from a plurality of source images including a first source image and a second source image, the pyramid data structure comprising a plurality of nodes, one or more nodes in the plurality of nodes having a payload comprising: a first Gaussian pixel value for the node, the first Gaussian pixel value computed from the first source image; anda second Gaussian pixel value for the node, the second Gaussian pixel value computed from the second source image. 20. The computer-readable medium of claim 19, wherein the second Gaussian pixel value is a projected Gaussian pixel value for the node.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.