Methods, apparatuses and computer program products for generating panoramic images using depth map data
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06T-003/40
H04N-005/232
H04N-013/00
G09G-005/377
출원번호
US-0122514
(2012-04-05)
등록번호
US-10102827
(2018-10-16)
우선권정보
IN-1856/CHE/2011 (2011-05-31)
국제출원번호
PCT/FI2012/050349
(2012-04-05)
§371/§102 date
20140110
(20140110)
국제공개번호
WO2012/164148
(2012-12-06)
발명자
/ 주소
Putraya, Gururaj Gopal
Mishra, Pranav
Govindarao, Krishna Annasagar
출원인 / 주소
Nokia Technologies Oy
대리인 / 주소
Alston & Bird LLP
인용정보
피인용 횟수 :
0인용 특허 :
6
초록▼
An apparatus for generating a panoramic image(s) may include a processor and memory storing executable computer code causing the apparatus to at least perform operations including generating a panoramic image(s) based on performing registration on at least two images associated with depth map data a
An apparatus for generating a panoramic image(s) may include a processor and memory storing executable computer code causing the apparatus to at least perform operations including generating a panoramic image(s) based on performing registration on at least two images associated with depth map data and determining an overlap region(s) between the two images within first and second items of depth map data. The computer program code may further cause the apparatus to label the overlap region(s) within the first or second item of depth map data based on generating a virtual seam(s) connecting portions of the two images to generate a composite image. The portions correspond to image data within first and second items of depth map data. The computer program code may further cause the apparatus to blend the seam of the composite image to obtain the panoramic image. Corresponding methods and computer program products are also provided.
대표청구항▼
1. A method comprising: generating at least one panoramic image based in part on performing registration on at least two images by dividing the at least two images into a first depth plane, a second depth plane, and a third depth plane using depth map data which provides depth associated with each p
1. A method comprising: generating at least one panoramic image based in part on performing registration on at least two images by dividing the at least two images into a first depth plane, a second depth plane, and a third depth plane using depth map data which provides depth associated with each pixel of the at least two images, wherein each depth plane of the first depth plane, the second depth plane, and the third depth plane includes an image formed by pixels which belong to a range of depth values;determining at least one overlap region between the at least two images within at least the first depth plane, the second depth plane, and the third depth plane;generating at least one virtual seam connecting portions of the two images in the overlap region to generate a composite image, each virtual seam being associated with each depth plane of the first depth plane, the second depth plane, and the third depth plane; andfacilitating blending of the at least one virtual seam of the composite image to obtain the generated panoramic image. 2. The method of claim 1, further comprising: capturing the two images with different viewpoints or image data obtained from different distances, wherein image information of a first image of the two images corresponds to image content of a second image of the two images. 3. The method of claim 1, wherein registration comprises determining one or more corner correspondences associated with the first, second, and third depth planes, the corner correspondences relate to one or more corner points in a first image of the two images in the overlap region that corresponds to one or more corner points in a second image of the two images in the overlap region. 4. The method of claim 3, further comprising: utilizing the corner correspondences to calculate a registration matrix. 5. The method of claim 1, wherein registration comprises determining one or more corner correspondences relating to one or more corner points in a first image of the two images in the overlap region that corresponds to one or more corner points in a second image of the two images in the overlap region, wherein the method further comprises: comparing respective corner correspondences to one or more corner points in the first image and the second image to determine whether at least one of the corner correspondences correspond to corner points associated with a same depth plane. 6. The method of claim 5, further comprising: eliminating a first subset of the corner points that are determined not to correspond to the respective corner correspondences from further processing; andutilizing a second subset of the corner points that are determined to correspond to the respective corner correspondences, in part, to calculate a registration matrix. 7. The method of claim 6, further comprising: verifying that the second subset of the corner points are valid based on the second subset of corner points being determined to correspond to the respective corner correspondences. 8. The method of claim 1, wherein the at least one virtual seam is associated with at least the first depth plane, the second depth plane, or the third depth plane and selection of at least the first depth plane, the second depth plane, or the third depth plane is based upon the quality of image data in each depth plane. 9. The method of claim 1, wherein the overlap region comprises a portion of a first image of the two images being superimposed over a portion of a second image of the two images. 10. An apparatus comprising: at least one processor; andat least one memory including computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: generate at least one panoramic image based in part on performing registration on at least two images by dividing the at least two images into a first depth plane, a second depth plane, and a third depth plane using depth map data which provides depth associated with each pixel of the at least two images, wherein each depth plane of the first depth plane, the second depth plane, and the third depth plane includes an image formed by pixels which belong to a range of depth values;determine at least one overlap region between the at least two images within at least the first depth plane, the second depth plane, and the third depth plane;generate at least one virtual seam connecting portions of the two images in the overlap region to generate a composite image, each virtual seam being associated with each depth plane of the first depth plane, the second depth plane, and the third depth plane; andfacilitate blending of the at least one virtual seam of the composite image to obtain the generated panoramic image. 11. The apparatus of claim 10, wherein the apparatus is further caused to perform: capture the two images with different viewpoints or image data obtained from different distances, wherein image information of a first image of the at least two images corresponds to image content of a second image of the at least two images. 12. The apparatus of claim 10, wherein the apparatus is further caused to: perform the registration by determining one or more corner correspondences associated with the first, second, and third depth planes, the corner correspondences relate to one or more corner points in a first image of the two images in the overlap region that corresponds to one or more corner points in a second image of the two images in the overlap region. 13. The apparatus of claim 12, wherein the apparatus is further caused to perform: utilize the corner correspondences to calculate a registration matrix. 14. The apparatus of claim 10, wherein the apparatus is further caused to: perform the registration by determining one or more corner correspondences relating to one or more corner points in a first image of the two images in the overlap region that corresponds to one or more corner points in a second image of the two images in the overlap region; andcompare respective corner correspondences to one or more corner points in the first image and the second image to determine whether at least one of the corner correspondences corresponds to corner points associated with a same depth plane. 15. The apparatus of claim 14, wherein the apparatus is further caused to perform: eliminate a first subset of the corner points that are determined not to correspond to the respective corner correspondences from further processing; andutilize a second subset of the corner points that are determined to correspond to the respective corner correspondences, in part, to calculate a registration matrix. 16. The apparatus of claim 15, wherein the apparatus is further caused to perform: verify that the second subset of the corner points are valid based on the second subset of corner points being determined to correspond to the respective corner correspondences. 17. A computer program product comprising at least one non-transitory computer-readable storage medium having computer executable program code instructions stored therein, the computer executable program code instructions configured to: generate at least one panoramic image based in part on performing registration on at least two images by dividing the at least two images into a first depth plane, a second depth plane, and a third depth plane using depth map data which provides depth associated with each pixel of the at least two images, wherein each depth plane of the first depth plane, the second depth plane, and the third depth plane includes an image formed by pixels which belong to a range of depth values;determine at least one overlap region between the at least two images within at least the first depth plane, the second depth plane, and the third depth plane;generate at least one virtual seam connecting portions of the two images in the overlap region to generate a composite image, each virtual seam being associated with each depth plane of the first depth plane, the second depth plane, and the third depth plane; andfacilitate blending of the at least one virtual seam of the composite image to obtain the generated panoramic image. 18. The computer program product of claim 17, wherein registration comprises determining one or more corner correspondences relating to one or more corner points in a first image of the two images in the overlap region that corresponds to one or more corner points in a second image of the two images in the overlap region, wherein the computer program product further comprising program code instructions configured to: compare respective corner correspondences to one or more corner points in the first image and the second image to determine whether at least one of the corner correspondences corresponds to corner points associated with a same depth plane. 19. The apparatus of claim 10, wherein the at least one virtual seam is associated with at least the first depth plane, the second depth plane, or the third depth plane and selection of at least the first depth plane, the second depth plane, or the third depth plane is based upon the quality of image data in each depth plane. 20. The computer program product of claim 17, wherein the at least one virtual seam is associated with at least the first depth plane, the second depth plane, or the third depth plane and selection of at least the first depth plane, the second depth plane, or the third depth plane is based upon the quality of image data in each depth plane.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (6)
Yalin Xiong, Blending arbitrary overlaying images into panoramas.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.