Focused plenoptic camera employing microlenses with different focal lengths
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G03B-013/00
H04N-005/232
출원번호
US-0628437
(2009-12-01)
등록번호
US-8400555
(2013-03-19)
발명자
/ 주소
Georgiev, Todor G.
Lumsdaine, Andrew
출원인 / 주소
Adobe Systems Incorporated
대리인 / 주소
Wolfe-SBMC
인용정보
피인용 횟수 :
134인용 특허 :
20
초록▼
Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing microlenses with different focal lengths. A focused plenoptic camera that includes an array of microlenses with at least two different focal lengths may be used to simultaneously capture microimages fro
Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing microlenses with different focal lengths. A focused plenoptic camera that includes an array of microlenses with at least two different focal lengths may be used to simultaneously capture microimages from at least two different planes at different distances from the microlens array. Image operations such as refocusing and focus bracketing may be performed on flats captured with the camera. Images may be constructed from subsets of the microimages captured using each type of microlens, thus creating multiple images each focused at a different depth. An array of stacked microlenses including stacks that provide different focal lengths may be used. The lens stacks may be provided by stacking two microlenses arrays on top of each other in the camera.
대표청구항▼
1. A camera, comprising: a photosensor configured to capture light projected onto the photosensor;an objective lens, wherein the objective lens is configured to refract light from a scene located in front of the camera to form an image of the scene at a plurality of different focal planes of the obj
1. A camera, comprising: a photosensor configured to capture light projected onto the photosensor;an objective lens, wherein the objective lens is configured to refract light from a scene located in front of the camera to form an image of the scene at a plurality of different focal planes of the objective lens;an optical element array positioned between the objective lens and the photosensor, wherein the optical element array comprises a plurality of optical elements, wherein the plurality of optical element are focused on the focal planes and not on the objective lens, and wherein at least two of the optical elements are of different focal lengths and are thus focused at different ones of the plurality of focal planes; andwherein each optical element of the optical element array is configured to project a separate portion of the image of the scene formed at the focal plane on which the optical element is focused onto a separate location on the photosensor. 2. The camera as recited in claim 1, wherein each optical element in the optical element array comprises a microlens, wherein at least two of the microlenses in different ones of the optical elements are of different focal lengths to thus focus at different ones of the plurality of focal planes. 3. The camera as recited in claim 1, wherein the optical element array is a microlens array comprising a plurality of microlenses, wherein at least two of the microlenses are of different focal lengths to thus focus at different ones of the plurality of focal planes. 4. The camera as recited in claim 1, wherein each optical element in the optical element array comprises a stack of multiple microlenses aligned on the optical axes of the microlenses, wherein at least two of the microlens stacks in different ones of the optical elements provide different focal lengths to thus focus at different ones of the plurality of focal planes. 5. The camera as recited in claim 1, wherein the optical element array comprises two microlens arrays each comprising a plurality of microlenses, wherein the microlenses in the two microlens arrays are aligned on the optical axes of the microlenses, and wherein at least two of the microlenses in at least one of the two microlens arrays are of different focal lengths to thus focus at different ones of the plurality of focal planes. 6. The camera as recited in claim 5, wherein a first microlens array of the two microlens arrays is positioned proximate to the photosensor, and wherein a second microlens array is positioned proximate to the first microlens array between the first microlens array and the objective lens. 7. The camera as recited in claim 5, wherein the microlenses in the first microlens array are all of the same focal length, and wherein at least two of the microlenses in the second microlens array are of different focal lengths to thus focus at the different ones of the plurality of focal planes. 8. The camera as recited in claim 7, wherein the microlenses in the first microlens array are positioned at a distance b from the photosensor, where b is equal to the focal length of the microlenses in the first microlens array. 9. The camera as recited in claim 1, wherein the photosensor is configured to capture a flat comprising the separate portions of the image of the scene projected onto the photosensor by the optical elements, wherein each of the separate portions is in a separate region of the flat, and wherein at least two of the separate portions are captured from different ones of the plurality of focal planes according to the different focal lengths of the optical elements that project the at least two separate portions onto the photosensor. 10. The camera as recited in claim 9, wherein the camera is configured to store the captured flat to a memory device. 11. The camera as recited in claim 1, wherein the camera is configured so that the plurality of focal planes are positioned between the objective lens and the optical element array. 12. The camera as recited in claim 1, wherein the camera is configured so that the plurality of focal planes are positioned behind the photosensor. 13. A method, comprising: receiving light from a scene at an objective lens of a camera;refracting light from the objective lens to form an image of the scene at a plurality of different focal planes of the objective lens;receiving light from the plurality of different focal planes at an optical element array positioned between the objective lens and a photosensor of the camera, wherein the optical element array comprises a plurality of optical elements, wherein the plurality of optical element are focused on the focal planes and not on the objective lens, and wherein at least two of the optical elements are of different focal lengths and are thus focused at different ones of the plurality of focal planes;receiving light from the optical element array at the photosensor, wherein the photosensor receives a separate portion of the image of the scene formed at one of the plurality of focal planes from each optical element of the optical element array at a separate location on the photosensor, and wherein at least one subset of the separate portions differs from at least one other subset of the separate portions according to the different focal lengths of the optical elements in the optical element array corresponding to the microlenses that project the at least one subset of the separate portions onto the photosensor. 14. The method as recited in claim 13, wherein the optical element array is a microlens array comprising a plurality of microlenses, wherein at least two of the microlenses are of different focal lengths to thus focus at different ones of the plurality of focal planes. 15. The method as recited in claim 13, wherein the optical element array comprises two microlens arrays each comprising a plurality of microlenses, wherein the microlenses in the two microlens arrays are aligned on the optical axes of the microlenses, and wherein at least two of the microlenses in at least one of the two microlens arrays are of different focal lengths to thus focus at different ones of the plurality of focal planes. 16. The method as recited in claim 15, wherein a first microlens array of the two microlens arrays is positioned proximate to the photosensor, wherein a second microlens array is positioned proximate to the first microlens array between the first microlens array and the objective lens, wherein the microlenses in the first microlens array are all of the same focal length, wherein at least two of the microlenses in the second microlens array are of different focal lengths to thus focus at the different ones of the plurality of focal planes, and wherein the microlenses in the first microlens array are positioned at a distance b from the photosensor, where b is equal to the focal length of the microlenses in the first microlens array. 17. The method as recited in claim 13, further comprising capturing a flat comprising the separate portions of the image of the scene projected onto the photosensor by the microlenses, wherein each of the separate portions is in a separate region of the flat. 18. The method as recited in claim 17, further comprising: appropriately combining the different separate portions from the subsets of the separate portions to generate a combined flat, wherein the combined flat comprises the combined separate portions of the image of the scene; andappropriately assembling the plurality of combined separate portions to produce one or more images of the scene. 19. The method as recited in claim 17, further comprising: appropriately assembling the separate portions from each of the subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andappropriately combining at least two of the two or more separate images of the scene to produce a combined image of the scene.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (20)
Raskar, Ramesh; Agrawal, Amit Kumar, 4D light field cameras.
Yamagata, Michihiro; Okayama, Hiroaki; Boku, Kazutake; Tanaka, Yasuhiro; Hayashi, Kenichi; Fushimi, Yoshimasa; Murata, Shigeki; Hayashi, Takayuki, Imaging device including a plurality of lens elements and a imaging sensor.
Duparre, Jacques; Lelescu, Dan; Venkataraman, Kartik, Array cameras incorporating monolithic array camera modules with high MTF lens stacks for capture of images used in super-resolution processing.
Duparre, Jacques; Lelescu, Dan; Venkataraman, Kartik, Array cameras incorporating optics with modulation transfer functions greater than sensor Nyquist frequency for capture of images used in super-resolution processing.
Venkataraman, Kartik; Gallagher, Paul; Jain, Ankit K.; Nisenzon, Semyon; Lelescu, Dan; Ciurea, Florian; Molina, Gabriel, Autofocus system for a conventional camera that uses depth information from an array camera.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions focused on an image sensor by a lens stack array.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions focused on an image sensor by a lens stack array.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view.
Chuang, Daniel B.; Candell, Lawrence M.; Ross, William D.; Beattie, Mark E.; Fang, Cindy Y.; Ren, Bobby; Blanchard, Jonathan P., Imaging system for immersive surveillance.
Elg, Johannes; Linåker, Daniel; Gustavsson, Jonas; Wernersson, Mats; Johansson, Allan, Method and apparatus for reducing color fringing in composite images.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Georgiev, Todor G.; Lumsdaine, Andrew, Methods, apparatus, and computer-readable storage media for depth-based rendering of focused plenoptic camera data.
Duparre, Jacques, Passive alignment of array camera modules constructed from lens stack arrays and sensors based upon alignment information obtained during manufacture of array camera modules using an active alignment process.
Srikanth, Manohar; Ramamoorthi, Ravi; Venkataraman, Kartik; Chatterjee, Priyam, System and methods for depth regularization and semiautomatic interactive matting using RGB-D images.
Nayar, Shree; Venkataraman, Kartik; Pain, Bedabrata; Lelescu, Dan, Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures.
Lelescu, Dan; Venkataraman, Kartik, Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing.
Duparré, Jacques, Systems and methods for correcting for warpage of a sensor array in an array camera module by introducing warpage into a focal plane of a lens stack array.
Duparre, Jacques; McMahon, Andrew Kenneth John; Lelescu, Dan; Venkataraman, Kartik; Molina, Gabriel, Systems and methods for detecting defective camera arrays and optic arrays.
Duparre, Jacques; McMahon, Andrew Kenneth John; Lelescu, Dan; Venkataraman, Kartik; Molina, Gabriel, Systems and methods for detecting defective camera arrays and optic arrays.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints.
Venkataraman, Kartik; Lelescu, Dan; Molina, Gabriel, Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view.
Duparre, Jacques; McMahon, Andrew Kenneth John; Lelescu, Dan, Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors.
Duparre, Jacques; McMahon, Andrew Kenneth John; Lelescu, Dan, Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for measuring depth using images captured by a camera array including cameras surrounding a central camera.
Venkataraman, Kartik; Huang, Yusong; Jain, Ankit K.; Chatterjee, Priyam, Systems and methods for performing high speed video capture and depth estimation using array cameras.
Lelescu, Dan; Duong, Thang, Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information.
Venkataraman, Kartik; Nisenzon, Semyon; Chatterjee, Priyam; Molina, Gabriel, Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies.
Shabtay, Gal; Cohen, Noy; Geva, Nadav; Gigushinski, Oded; Goldenberg, Ephraim, Thin multi-aperture imaging system with auto-focus and methods for using same.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.