Focused plenoptic camera employing different apertures or filtering at different microlenses
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/235
G03B-003/00
출원번호
US-0549330
(2012-07-13)
등록번호
US-8471920
(2013-06-25)
발명자
/ 주소
Georgiev, Todor G.
Lumsdaine, Andrew
출원인 / 주소
Adobe Systems Incorporated
대리인 / 주소
Wolfe-SBMC
인용정보
피인용 횟수 :
23인용 특허 :
74
초록▼
Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing different filtering at different microlenses. In a focused plenoptic camera, the main lens creates an image at the focal plane. That image is re-imaged on the sensor multiple times by an array of microl
Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing different filtering at different microlenses. In a focused plenoptic camera, the main lens creates an image at the focal plane. That image is re-imaged on the sensor multiple times by an array of microlenses. Different filters that provide different levels and/or types of filtering may be combined with different ones of the microlenses. A flat captured with the camera includes multiple microimages captured according to the different filters. Multiple images may be assembled from the microimages, with each image assembled from microimages captured using a different filter. A final image may be generated by appropriately combining the images assembled from the microimages. Alternatively, a final image, or multiple images, may be assembled from the microimages by first combining the microimages and then assembling the combined microimages to produce one or more output images.
대표청구항▼
1. A method, comprising: performing, by an electronic device: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, and wherein the plurality of separate portions include at least t
1. A method, comprising: performing, by an electronic device: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, and wherein the plurality of separate portions include at least two subsets of the separate portions that were captured at different levels of exposure; andgenerating one or more High Dynamic Range (HDR) images of the scene from the plurality of separate portions of the image of the scene. 2. The method as recited in claim 1, wherein said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene comprises: assembling the separate portions from each of the two or more subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombining at least two of the two or more separate images of the scene to produce an HDR image of the scene. 3. The method as recited in claim 1, wherein said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene comprises: separating the two or more subsets of the separate portions into two or more intermediate flats, each intermediate flat corresponding to a particular subset of the separate portions;assembling the separate portions from the two or more intermediate flats to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombining at least two of the two or more separate images of the scene to produce an HDR image of the scene. 4. The method as recited in claim 1, wherein said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene comprises: combining the separate portions from the at least two subsets that were captured at different levels of exposure to generate an HDR flat, wherein the HDR flat comprises the combined separate portions of the image of the scene from the at least two subsets; andassembling the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene. 5. The method as recited in claim 4, wherein said combining the separate portions from the at least two subsets comprises: shifting the separate portions in at least one of the subsets; andcombining the shifted separate portions with respective ones of the separate portions in another one of the subsets. 6. The method as recited in claim 4, wherein said assembling the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene comprises: cropping each of the plurality of combined separate portions from the HDR flat to produce a plurality of separate cropped portions; andmoving the plurality of separate cropped portions together to produce the HDR image of the scene. 7. The method as recited in claim 1, wherein the flat is captured by a camera comprising an array of filters or apertures and an array of microlenses, wherein at least one subset of the filters or apertures allows a different amount of light to pass through respective microlenses than at least one other subset of the filters or apertures so that the separate portions of the image of the scene are captured in the flat at the different levels of exposure. 8. The method as recited in claim 7, wherein the electronic device is the camera. 9. A system, comprising: one or more processors; anda memory comprising program instructions executable by at least one of the one or more processors to: obtain a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, and wherein the plurality of separate portions include at least two subsets of the separate portions that were captured at different levels of exposure; andgenerate one or more High Dynamic Range (HDR) images of the scene from the plurality of separate portions of the image of the scene. 10. The system as recited in claim 9, wherein, to generate one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are executable by at least one of the one or more processors to: assemble the separate portions from each of the two or more subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombine at least two of the two or more separate images of the scene to produce an HDR image of the scene. 11. The system as recited in claim 9, wherein, to generate one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are executable by at least one of the one or more processors to: separate the two or more subsets of the separate portions into two or more intermediate flats, each intermediate flat corresponding to a particular subset of the separate portions;assemble the separate portions from the two or more intermediate flats to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombine at least two of the two or more separate images of the scene to produce an HDR image of the scene. 12. The system as recited in claim 9, wherein, to generate one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are executable by at least one of the one or more processors to: combine the separate portions from the at least two subsets that were captured at different levels of exposure to generate an HDR flat, wherein the HDR flat comprises the combined separate portions of the image of the scene from the at least two subsets; andassemble the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene. 13. The system as recited in claim 12, wherein, to combine the separate portions from the at least two subsets, the program instructions are executable by at least one of the one or more processors to: shift the separate portions in at least one of the subsets; andcombine the shifted separate portions with respective ones of the separate portions in another one of the subsets. 14. The system as recited in claim 12, wherein, to assemble the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene, the program instructions are executable by at least one of the one or more processors to: crop each of the plurality of combined separate portions from the HDR flat to produce a plurality of separate cropped portions; andmove the plurality of separate cropped portions together to produce the HDR image of the scene. 15. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement: obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, and wherein the plurality of separate portions include at least two subsets of the separate portions that were captured at different levels of exposure; andgenerating one or more High Dynamic Range (HDR) images of the scene from the plurality of separate portions of the image of the scene. 16. The non-transitory computer-readable storage medium as recited in claim 15, wherein, in said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are computer-executable to implement: assembling the separate portions from each of the two or more subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombining at least two of the two or more separate images of the scene to produce an HDR image of the scene. 17. The non-transitory computer-readable storage medium as recited in claim 15, wherein, in said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are computer-executable to implement: separating the two or more subsets of the separate portions into two or more intermediate flats, each intermediate flat corresponding to a particular subset of the separate portions;assembling the separate portions from the two or more intermediate flats to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andcombining at least two of the two or more separate images of the scene to produce an HDR image of the scene. 18. The non-transitory computer-readable storage medium as recited in claim 15, wherein, in said generating one or more HDR images of the scene from the plurality of separate portions of the image of the scene, the program instructions are computer-executable to implement: combining the separate portions from the at least two subsets that were captured at different levels of exposure to generate an HDR flat, wherein the HDR flat comprises the combined separate portions of the image of the scene from the at least two subsets; andassembling the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene. 19. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said combining the separate portions from the at least two subsets, the program instructions are computer-executable to implement: shifting the separate portions in at least one of the subsets; andcombining the shifted separate portions with respective ones of the separate portions in another one of the subsets. 20. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said assembling the plurality of combined separate portions from the HDR flat to produce an HDR image of the scene, the program instructions are computer-executable to implement: cropping each of the plurality of combined separate portions from the HDR flat to produce a plurality of separate cropped portions; andmoving the plurality of separate cropped portions together to produce the HDR image of the scene.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (74)
Georgiev Todor, 3D graphics based on images and morphing.
Loce Robert P. (Rochester NY) Cianciosi Michael S. (Rochester NY) Kingsley Jeffrey D. (Williamson NY), Image resolution conversion method that employs statistically generated multiple morphological filters.
Yamagata, Michihiro; Okayama, Hiroaki; Boku, Kazutake; Tanaka, Yasuhiro; Hayashi, Kenichi; Fushimi, Yoshimasa; Murata, Shigeki; Hayashi, Takayuki, Imaging device including a plurality of lens elements and a imaging sensor.
de Montebello Roger L. (New York NY) Globus Ronald P. (New York NY) Buck Howard S. (New York NY), Integral photography apparatus and method of forming same.
Mindler, Robert F.; Calkins, Guy T., Method and apparatus for thermal printing of longer length images by the use of multiple dye color patch triads or quads.
Corle Timothy R. (Santa Clara County CA) Kino Gordon S. (Santa Clara County CA) Mansfield Scott M. (San Mateo County CA), Optical recording system employing a solid immersion lens.
Patton, David L.; Spoonhower, John P.; Bohan, Anne E.; Paz-Pujalt, Gustavo R., Solid immersion lens array and methods for producing a solid immersion lens array.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Georgiev, Todor G.; Lumsdaine, Andrew, Methods, apparatus, and computer-readable storage media for depth-based rendering of focused plenoptic camera data.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.