IPC분류정보
국가/구분 |
United States(US) Patent
등록
|
국제특허분류(IPC7판) |
|
출원번호 |
US-0476638
(2012-05-21)
|
등록번호 |
US-8379105
(2013-02-19)
|
발명자
/ 주소 |
- Georgiev, Todor G.
- Lumsdaine, Andrew
|
출원인 / 주소 |
- Adobe Systems Incorporated
|
인용정보 |
피인용 횟수 :
13 인용 특허 :
34 |
초록
▼
Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be locat
Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to flats captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.
대표청구항
▼
1. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a se
1. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene;assembling the plurality of separate portions to produce a first high-resolution image of the scene, wherein at least two pixels from each portion is included in the first high-resolution image;inverting each of the plurality of separate portions relative to their respective centers to produce a plurality of inverted portions;assembling the plurality of inverted portions to produce a second high-resolution image of the scene, wherein at least two pixels from each inverted portion is included in the second high-resolution image; andcombining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene. 2. The non-transitory computer-readable storage medium as recited in claim 1, wherein the program instructions are further computer-executable to implement cropping each of the plurality of separate portions prior to said assembling the plurality of separate portions, said inverting, said assembling the plurality of inverted portions, and said combining. 3. The non-transitory computer-readable storage medium as recited in claim 1, wherein, in said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are computer-executable to implement: determining one or more regions of one of the first high-resolution image or the second high-resolution image to be combined with the other one of the first high-resolution image or the second high-resolution image; andcombining the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 4. The non-transitory computer-readable storage medium as recited in claim 1, wherein, in said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are computer-executable to implement: receiving input via a user interface selecting one or more regions in one of the first high-resolution image or the second high-resolution image; andcombining the selected one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 5. The non-transitory computer-readable storage medium as recited in claim 1, wherein, in said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are computer-executable to implement: determining one or more regions in one of the first high-resolution image or the second high-resolution image according to an image quality criterion; andcombining the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 6. The non-transitory computer-readable storage medium as recited in claim 5, wherein the image quality criterion is noise. 7. The non-transitory computer-readable storage medium as recited in claim 1, wherein, in said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are computer-executable to implement: determining one or more regions in one of the first high-resolution image or the second high-resolution image in which noise is above a specified threshold; andreplacing the one or more regions in the one of the first high-resolution image or the second high-resolution image with corresponding one or more regions from the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 8. The non-transitory computer-readable storage medium as recited in claim 1, wherein the program instructions are further computer-executable to implement generating one or more other high-resolution images from the flat, wherein, in said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are computer-executable to implement combining at least one of the one or more other high-resolution images with the first high-resolution image and the second high-resolution image to produce the final high-resolution image of the scene. 9. A device, comprising: one or more processors; anda memory comprising program instructions, wherein the program instructions are executable by the at least one of the one or more processors to: obtain a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene;assemble the plurality of separate portions to produce a first high-resolution image of the scene, wherein at least two pixels from each portion is included in the first high-resolution image;invert each of the plurality of separate portions relative to their respective centers to produce a plurality of inverted portions;assemble the plurality of inverted portions to produce a second high-resolution image of the scene, wherein at least two pixels from each inverted portion is included in the second high-resolution image; andcombine the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene. 10. The device as recited in claim 9, wherein the program instructions are further executable by the at least one of the one or more processors to crop each of the plurality of separate portions prior to said assemble the plurality of separate portions, said invert, said assemble the plurality of inverted portions, and said combine. 11. The device as recited in claim 9, wherein, to combine the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are executable by the at least one of the one or more processors to: determine one or more regions of one of the first high-resolution image or the second high-resolution image to be combined with the other one of the first high-resolution image or the second high-resolution image; andcombine the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 12. The device as recited in claim 9, wherein, to combine the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are executable by the at least one of the one or more processors to: receive input via a user interface selecting one or more regions in one of the first high-resolution image or the second high-resolution image; andcombine the selected one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 13. The device as recited in claim 9, wherein, to combine the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are executable by the at least one of the one or more processors to: determine one or more regions in one of the first high-resolution image or the second high-resolution image according to an image quality criterion; andcombine the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 14. The device as recited in claim 9, wherein, to combine the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene, the program instructions are executable by the at least one of the one or more processors to: determine one or more regions in one of the first high-resolution image or the second high-resolution image in which noise is above a specified threshold; andreplace the one or more regions in the one of the first high-resolution image or the second high-resolution image with corresponding one or more regions from the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 15. A method, comprising: performing, by one or more computing devices: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene;assembling the plurality of separate portions to produce a first high-resolution image of the scene, wherein at least two pixels from each portion is included in the first high-resolution image;inverting each of the plurality of separate portions relative to their respective centers to produce a plurality of inverted portions;assembling the plurality of inverted portions to produce a second high-resolution image of the scene, wherein at least two pixels from each inverted portion is included in the second high-resolution image; andcombining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene. 16. The method as recited in claim 15, wherein said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene comprises: determining one or more regions of one of the first high-resolution image or the second high-resolution image to be combined with the other one of the first high-resolution image or the second high-resolution image; andcombining the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 17. The method as recited in claim 15, wherein said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene comprises: receiving input via a user interface selecting one or more regions in one of the first high-resolution image or the second high-resolution image; andcombining the selected one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 18. The method as recited in claim 15, wherein said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene comprises: determining one or more regions in one of the first high-resolution image or the second high-resolution image according to an image quality criterion; andcombining the determined one or more regions with the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 19. The method as recited in claim 15, wherein, wherein said combining the first high-resolution image with the second high-resolution image to produce a final high-resolution image of the scene comprises: determining one or more regions in one of the first high-resolution image or the second high-resolution image in which noise is above a specified threshold; andreplacing the one or more regions in the one of the first high-resolution image or the second high-resolution image with corresponding one or more regions from the other one of the first high-resolution image or the second high-resolution image to produce the final high-resolution image of the scene. 20. The method as recited in claim 15, wherein said obtaining a flat comprises: receiving light from the scene at an objective lens of a camera;refracting light from the objective lens to form an image of the scene at an image plane of the objective lens;receiving light from the image plane at a microlens array located between the objective lens and a photosensor of the camera, wherein the microlens array comprises a plurality of microlenses, and wherein the plurality of microlenses are focused on the image plane and not on the objective lens;receiving light from the microlens array at the photosensor, wherein the photosensor receives a separate portion of the image of the scene formed at the image plane by the objective lens from each microlens of the microlens array at a separate location on the photosensor; andcapturing the flat of the scene at the photosensor, wherein the flat includes each of the plurality of separate portions of the image of the scene in a separate region of the flat.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.