초록 ▼

Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing different filtering at different microlenses. In a focused plenoptic camera, the main lens creates an image at the focal plane. That image is re-imaged on the sensor multiple times by an array of microl

Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing different filtering at different microlenses. In a focused plenoptic camera, the main lens creates an image at the focal plane. That image is re-imaged on the sensor multiple times by an array of microlenses. Different filters that provide different levels and/or types of filtering may be combined with different ones of the microlenses. A flat captured with the camera includes multiple microimages captured according to the different filters. Multiple images may be assembled from the microimages, with each image assembled from microimages captured using a different filter. A final image may be generated by appropriately combining the images assembled from the microimages. Alternatively, a final image, or multiple images, may be assembled from the microimages by first combining the microimages and then assembling the combined microimages to produce one or more output images.

대표청구항 ▼

1. A camera, comprising: a photosensor configured to capture light projected onto the photosensor;an objective lens, wherein the objective lens is configured to refract light from a scene located in front of the camera to form an image of the scene at an image plane of the objective lens;a microlens

1. A camera, comprising: a photosensor configured to capture light projected onto the photosensor;an objective lens, wherein the objective lens is configured to refract light from a scene located in front of the camera to form an image of the scene at an image plane of the objective lens;a microlens array positioned between the objective lens and the photosensor, wherein the microlens array comprises a plurality of microlenses, wherein the plurality of microlenses are focused on the image plane and not on the objective lens, wherein each microlens of the microlens array is configured to project a separate portion of the image of the scene formed at the image plane by the objective lens onto a separate location on the photosensor; andan optical element array proximate to the microlens array, wherein the optical element array is configured to affect light that passes through the microlens array to the photosensor, wherein the optical element array comprises a plurality of optical elements, wherein each optical element in the optical element array corresponds to a particular one of the plurality of microlenses, and wherein at least one of the optical elements in the optical element array is configured to affect light differently than at least one other optical element in the optical element array. 2. The camera as recited in claim 1, wherein the optical elements in the optical element array include apertures that affect the amount of light that passes through the microlens array to the photosensor, wherein at least two of the apertures are of different diameters to allow different amounts of light to pass through respective microlenses to the photosensor. 3. The camera as recited in claim 1, wherein the optical elements in the optical element array include neutral density filters that affect the amount of light that passes through respective microlenses in the microlens array to the photosensor, wherein at least two of the neutral density filters allow different amounts of light to pass through respective microlenses to the photosensor. 4. The camera as recited in claim 1, wherein the optical elements in the optical element array include color filters that affect the wavelengths of light that passes through respective microlenses in the microlens array to the photosensor, wherein at least two of the color filters allow different wavelengths of light to pass through respective microlenses to the photosensor. 5. The camera as recited in claim 1, wherein the optical elements in the optical element array include polarizing filters that affect the polarization of light that passes through respective microlenses in the microlens array to the photosensor, wherein at least two of the polarizing filters allow different polarizations of light to pass through respective microlenses to the photosensor. 6. The camera as recited in claim 1, wherein the optical elements in the optical element array include at least two different types of optical elements, wherein the types of optical elements include apertures that affect the amount of light that passes through the microlens array to the photosensor, neutral density filters that affect the amount of light that passes through respective microlenses in the microlens array to the photosensor, color filters that affect the wavelengths of light that passes through respective microlenses in the microlens array to the photosensor, and polarizing filters that affect the polarization of light that passes through respective microlenses in the microlens array to the photosensor. 7. The camera as recited in claim 1, wherein the optical element array is positioned between the microlens array and the photosensor. 8. The camera as recited in claim 1, wherein the optical element array is positioned between the objective lens and the microlens array. 9. The camera as recited in claim 1, wherein the photosensor is configured to capture a flat comprising the separate portions of the image of the scene projected onto the photosensor by the microlenses, wherein each of the separate portions is in a separate region of the flat, and wherein at least two of the separate portions differ according to the different effects of the optical elements corresponding to the microlenses that projected the at least two separate portions onto the photosensor. 10. The camera as recited in claim 9, wherein the camera is configured to store the captured flat to a memory device. 11. The camera as recited in claim 1, wherein the camera is configured so that the image plane of the objective lens is positioned between the objective lens and the microlens array. 12. The camera as recited in claim 1, wherein the camera is configured so that the image plane of the objective lens is positioned behind the photosensor. 13. A method, comprising: receiving light from a scene at an objective lens of a camera;refracting light from the objective lens to form an image of the scene at an image plane of the objective lens;receiving light from the image plane at an array located between the objective lens and a photosensor of the camera and parallel to the image plane, wherein the array comprises a plurality of microlenses, wherein each of the plurality of microlenses is focused on the image plane and not on the objective lens, and wherein the array further comprises a plurality of filters or apertures, wherein each filter or aperture in the array corresponds to a particular one of the plurality of microlenses in the array, and wherein at least one subset of the filters or apertures affects light differently than at least one other subset of the filters or apertures in the array;receiving light from the array at the photosensor, wherein the photosensor receives a separate portion of the image of the scene formed at the image plane by the objective lens from each microlens of the array at a separate location on the photosensor, and wherein at least one subset of the separate portions differs from at least one other subset of the separate portions according to the different effects of the filters or apertures in the array corresponding to the microlenses that projected the at least one subset of the separate portions onto the photosensor. 14. The method as recited in claim 13, wherein the filters or apertures in the array include filters that affect the wavelengths of light, and wherein the at least one subset of the filters or apertures allows different wavelengths of light to pass through respective microlenses than the at least one other subset of the filters or apertures in the array. 15. The method as recited in claim 13, wherein the filters or apertures in the array include filters that affect the polarization of light, and wherein the at least one subset of the filters or apertures allows a different polarization of light to pass through respective microlenses than the at least one other subset of the filters or apertures in the array. 16. The method as recited in claim 13, wherein the filters or apertures in the array affect the amount of light that passes through the microlens array to the photosensor, and wherein the at least one subset of the filters or apertures allows a different amount of light to pass through respective microlenses than the at least one other subset of the filters or apertures in the array. 17. The method as recited in claim 13, further comprising capturing a flat comprising the separate portions of the image of the scene projected onto the photosensor by the microlenses, wherein each of the separate portions is in a separate region of the flat. 18. The method as recited in claim 17, further comprising: appropriately combining the different separate portions from the subsets of the separate portions to generate a combined flat, wherein the combined flat comprises the combined separate portions of the image of the scene; andappropriately assembling the plurality of combined separate portions to produce one or more images of the scene. 19. The method as recited in claim 17, further comprising: appropriately assembling the separate portions from each of the subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andappropriately combining at least two of the two or more separate images of the scene to produce a combined image of the scene. 20. The method as recited in claim 17, further comprising storing the captured flat to a memory. 21. The method as recited in claim 17, wherein the filters or apertures in the array affect the amount of light that passes through the microlens array to the photosensor, and wherein the at least one subset of the filters or apertures allows a different amount of light to pass through respective microlenses than the at least one other subset of the filters or apertures in the array so that separate portions of the image of the scene are captured at different levels of exposure by different filters or apertures. 22. The method as recited in claim 21, further comprising: appropriately combining the different separate portions from the subsets of the separate portions to generate a High Dynamic Range (HDR) flat, wherein the HDR flat comprises the combined separate portions of the image of the scene; andappropriately assembling the plurality of combined separate portions to produce one or more HDR images of the scene. 23. The method as recited in claim 21, further comprising: appropriately assembling the separate portions from each of the subsets of the separate portions to generate two or more separate images of the scene each corresponding to a particular subset of the separate portions; andappropriately combining at least two of the two or more separate images of the scene to produce a High Dynamic Range (HDR) image of the scene.