Thin form factor computational array cameras and modular array cameras
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/225
H04N-005/33
H04N-005/349
출원번호
US-0188521
(2014-02-24)
등록번호
US-9374512
(2016-06-21)
발명자
/ 주소
Venkataraman, Kartik
Gallagher, Paul
Lelescu, Dan
McMahon, Andrew Kenneth John
Duparre, Jacques
출원인 / 주소
Pelican Imaging Corporation
대리인 / 주소
KPPB LLP
인용정보
피인용 횟수 :
10인용 특허 :
195
초록▼
Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each
Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.
대표청구항▼
1. A 1×N array camera module comprising: a plurality of 1×X sub-array modules, each comprising: a 1×X arrangement of focal planes, wherein: X is greater than or equal to 1;each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels;each focal plane does n
1. A 1×N array camera module comprising: a plurality of 1×X sub-array modules, each comprising: a 1×X arrangement of focal planes, wherein: X is greater than or equal to 1;each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels;each focal plane does not include pixels from another focal plane; andthe 1×X arrangement of focal planes is embodied within an integrated circuit that does not include any focal planes of another 1×X sub-array module; anda 1×X arrangement of lens stacks, the 1×X arrangement of lens stacks being disposed relative to the 1×X arrangement of focal planes so as to form a 1×X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene;image data output circuitry that is configured to output image data from the 1×X sub-array module that is capable of being aggregated with image data from other 1×X sub-array modules to construct an image of the scene; andinterface circuitry configured to couple, either directly or indirectly, with one of: another 1×X sub-array module or a processor that is in electrical communication with at least one other 1×X sub-array module; wherein the interface circuitry is configured to transmit output image data to a directly or indirectly coupled 1×X sub-array module or a directly or indirectly coupled processor that is in electrical communication with at least one other 1×X sub-array module;wherein the plurality of 1×X sub-array modules are positioned in a one-dimensional arrangement so as to form a 1×N arrangement of cameras; and wherein N is greater than or equal to 2. 2. The array camera module of claim 1 wherein N is greater than or equal to 3. 3. The array camera module of claim 2, wherein N is 5. 4. The array camera module of claim 3, wherein the 1×N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum. 5. The array camera module of claim 4, wherein the green camera is centrally disposed relative to the 1×N arrangement of cameras. 6. The array camera of claim 5, wherein the lens stack of the green camera is configured to focus light corresponding with the green band of the visible spectrum onto the corresponding focal plane. 7. The array camera of claim 5, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera. 8. The array camera module of claim 2, wherein N is 7. 9. The array camera module of claim 8, wherein the 1×N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×N arrangement of cameras. 10. The array camera module of claim 9, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera. 11. The array camera module of claim 2, wherein N is 9. 12. The array camera module of claim 11, wherein the 1×N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×N arrangement of cameras. 13. The array camera module of claim 12, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera. 14. The array camera module of claim 1, wherein the 1×N arrangement of lens stacks is embodied within a monolithic structure. 15. The array camera module of claim 1, wherein N is 9, and X is 3 for at least one sub-array module. 16. The array camera module of claim 15, wherein N is 9 and X is 3 for each of the plurality of sub-array modules. 17. The array camera module of claim 1, wherein each of at least two sub-array modules are adjoined to the interconnects of a single substrate, and are thereby in electrical communication with each other. 18. The array camera module of claim 17, wherein the substrate is optically transparent. 19. The array camera module of claim 18, wherein the substrate is glass. 20. A 1×X sub-array module comprising: a 1×X arrangement of focal planes, wherein: X is greater than or equal to 1;each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels;each focal plane does not include pixels from another focal plane; andthe 1×X arrangement of focal planes is embodied within an integrated circuit that does not include any focal planes of another 1×X sub-array module;a 1×X arrangement of lens stacks, the 1×X arrangement of lens stacks being disposed relative to the 1×X arrangement of focal planes so as to form a 1×X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene;image data output circuitry that is configured to output image data from the 1×X sub-array module that is capable of being aggregated with image data from another 1×X sub-array module to construct an image of the scene; andinterface circuitry configured to couple, either directly or indirectly, with one of: another 1×X sub-array module or a processor that is in electrical communication with at least one other 1×X sub-array module; wherein the interface circuitry is configured to transmit output image data to a directly or indirectly coupled processor that is in electrical communication with at least one other 1×X sub-array module. 21. The sub-array module of claim 20, wherein the interface circuitry implements a MIPI CSI 2 interface. 22. A 1×N array camera comprising: a plurality of 1×X sub-array modules, each comprising: a 1×X arrangement of focal planes, wherein: X is greater than or equal to 1;each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels;each focal plane does not include pixels from another focal plane; andthe 1×X arrangement of focal planes is embodied within an integrated circuit that does not include any focal planes of another 1×X sub-array module; anda 1×X arrangement of lens stacks, the 1×X arrangement of lens stacks being disposed relative to the 1×X arrangement of focal planes so as to form a 1×X arrangement of cameras, each of which being configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene;image data output circuitry that is configured to output image data from the 1×X sub-array module that is capable of being aggregated with image data from other 1×X sub-array modules to construct an image of the scene; andinterface circuitry configured to couple, either directly or indirectly, with one of: another 1×X sub-array module or a processor that is in electrical communication with at least one other 1×X sub-array module; wherein the interface circuitry is configured to transmit output image data to a directly or indirectly coupled 1×X sub-array module or a directly or indirectly coupled processor that is in electrical communication with at least one other 1×X sub-array module;wherein the plurality of 1×X sub-array modules are positioned in a one-dimensional arrangement so as to form a 1×N arrangement of cameras; wherein N is greater than or equal to 2; anda processor that is configured to construct an image of the scene using image data generated by the 1×N arrangement of cameras.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (195)
Wilburn, Bennett; Joshi, Neel; Levoy, Marc C.; Horowitz, Mark, Apparatus and method for capturing a scene using staggered triggering of dense camera arrays.
Iwase Toshihiro (Nara JPX) Kanekura Hiroshi (Yamatokouriyama JPX), Apparatus for and method of converting a sampling frequency according to a data driven type processing.
Boisvert, David Michael; McMahon, Andrew Kenneth John, CCD output processing stage that amplifies signals from colored pixels based on the conversion efficiency of the colored pixels.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions captured by arrays of luma and chroma cameras.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions captured by camera arrays.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions focused on an image sensor by a lens stack array.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Capturing and processing of images using monolithic camera array with heterogeneous imagers.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images using monolithic camera array with heterogeneous imagers.
Yamashita,Syugo; Murata,Haruhiko; Iinuma,Toshiya; Nakashima,Mitsuo; Mori,Takayuki, Device and method for converting two-dimensional video to three-dimensional video.
Pertsel, Shimon; Meitav, Ohad; Pozniansky, Eli; Galil, Erez, Digital camera with selectively increased dynamic range by control of parameters during image acquisition.
Ward, Gregory John; Seetzen, Helge; Heidrich, Wolfgang, Electronic camera having multiple sensors for capturing high dynamic range images and related methods.
Hornback,Bert; Harwood,Doug; Boyd,W. Eric; Carlson,Randy, Imaging device with multiple fields of view incorporating memory-based temperature compensation of an uncooled focal plane array.
Abell Gurdon R. (West Woodstock CT) Cook Francis J. (Topsfield MA) Howes Peter D. (Sudbury MA), Method and apparatus for arraying image sensor modules.
Sawhney,Harpreet Singh; Tao,Hai; Kumar,Rakesh; Hanna,Keith, Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery.
Burt Peter J. (Mercer County NJ) van der Wal Gooitzen S. (Mercer NJ) Kolczynski Raymond J. (Mercer NJ) Hingorani Rajesh (Mercer NJ), Method for fusing images and apparatus therefor.
Burt Peter J. (Princeton NJ) van der Wal Gooitzen S. (Hopewell Borough ; Mercer County NJ) Kolczynski Raymond J. (Hamilton Township ; Mercer County NJ) Hingorani Rajesh (West Windsor Township ; Merce, Method for fusing images and apparatus therefor.
Han, Hee-chul; Choi, Yang-lim; Cho, Seung-ki, Method of generating image data by an image device including a plurality of lenses and apparatus for generating image data.
Alexander David H. (Santa Monica CA) Hershman George H. (Carlsbad CA) Jack Michael D. (Carlsbad CA) Koda N. John (Vista CA) Lloyd Randahl B. (San Marcos CA), Monolithic imager for near-IR.
Hornbaker ; III Cecil V. (New Carrolton MD) Driggers Thomas C. (Falls Church VA) Bindon Edward W. (Fairfax VA), Scanning apparatus using multiple CCD arrays and related method.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, System and methods for measuring depth using an array camera employing a bayer filter.
Lelescu, Dan; Molina, Gabriel; Venkataraman, Kartik, Systems and methods for dynamic refocusing of high resolution images generated using images captured by a plurality of imagers.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for generating depth maps and corresponding confidence maps indicating depth estimation reliability.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Systems and methods for generating depth maps using a set of images containing a baseline image.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for measuring depth in the presence of occlusions using a subset of images.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for parallax detection and correction in images captured using array cameras that contain occlusions using subsets of images to perform depth estimation.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for parallax measurement using camera arrays incorporating 3 x 3 camera configurations.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for performing depth estimation using image data from multiple spectral channels.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for performing post capture refocus using images captured by camera arrays.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Systems and methods for synthesizing higher resolution images using a set of images containing a baseline image.
Ludwig, Lester F., Vignetted optoelectronic array for use in synthetic image formation via signal processing, lensless cameras, and integrated camera-displays.
Rieger Albert,DEX ; Barclay David ; Chapman Steven ; Kellner Heinz-Andreas,DEX ; Reibl Michael,DEX ; Rydelek James G. ; Schweizer Andreas,DEX, Watertight body for accommodating a photographic camera.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H.; Duparre, Jacques; Hu, Shane Ching-Feng, Capturing and processing of images including occlusions focused on an image sensor by a lens stack array.
Venkataraman, Kartik; Lelescu, Dan; Molina, Gabriel, Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information.
Venkataraman, Kartik; Jabbi, Amandeep S.; Mullis, Robert H., Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras.
Duparre, Jacques; McMahon, Andrew Kenneth John; Lelescu, Dan, Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.