Methods and apparatus for using multiple optical chains in paralell
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G02B-013/00
H04N-005/238
H04N-005/265
G02B-017/00
G02B-017/08
G02B-007/18
H04N-005/225
H04N-005/235
G02B-013/16
G02B-013/22
G06T-011/60
G02B-003/00
G03B-017/17
출원번호
US-0147581
(2014-01-05)
등록번호
US-9671595
(2017-06-06)
발명자
/ 주소
Laroia, Rajiv
출원인 / 주소
Light Labs Inc.
대리인 / 주소
Straub, Michael P.
인용정보
피인용 횟수 :
13인용 특허 :
39
초록▼
Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have bee
Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.
대표청구항▼
1. A method of producing at least one image of a first scene area, the method comprising: operating a plurality of four or more optical chains in a camera device to capture images of portions of the first scene area, said images including at least a first image of a first portion of said first scene
1. A method of producing at least one image of a first scene area, the method comprising: operating a plurality of four or more optical chains in a camera device to capture images of portions of the first scene area, said images including at least a first image of a first portion of said first scene area, a second image of a second portion of said first scene area, a third image of a third portion of said first scene area, and a fourth image of a fourth portion of said first scene area, said plurality of four or more optical chains including:i) a first optical chain, said first optical chain including a first mirror located in a first corner portion of said camera device for redirecting light entering a first aperture located in a face of said camera device along a first light path extending inside said camera device from said first corner portion in a first direction along a first diagonal having a first angle with respect to a bottom of the camera device, said first direction extending towards a lower portion of said camera device, said first optical chain including a first lens through which said first light path extends towards a first sensor included in said first optical chain;ii) a second optical chain including a second mirror located in a second corner portion of said camera device for redirecting light entering a second aperture located in the face of said camera device along a second light path extending inside said camera device from said second corner portion in a second direction along a second diagonal having a second angle with respect to the bottom of the camera device, said second direction extending towards an upper portion of said camera device, said second optical chain including a second lens through which said second light path extends towards a second sensor included in said second optical chain;iii) a third optical chain including a third mirror located in a third portion of said camera device for redirecting light entering a third aperture located in the face of said camera device along a third light path extending inside said camera device in a third direction towards a third sensor included in said third optical chain; andiv) a fourth optical chain including a fourth mirror located in a fourth portion of said camera device for redirecting light entering a fourth aperture located in the face of said camera device along a fourth light path extending inside said camera device in a fourth direction towards a fourth sensor included in said fourth optical chain, said first, second, third and fourth light paths extending in different directions; andprocessing said first, second, third and fourth images to generate a first combined image of said first scene area. 2. The method of claim 1, wherein the first mirror precedes the first lens along said first light path. 3. The method of claim 2, wherein said first and second light paths cross. 4. The method of claim 2, wherein said first sensor is located in a bottom portion of said camera device. 5. The method of claim 4, wherein said second sensor is located in a top portion of said camera device. 6. The method of claim 5, wherein the third optical chain includes a third lens. 7. The method of claim 5, wherein said third aperture is located in a top portion of said camera device, said third sensor being located in a bottom portion of said camera device. 8. The method of claim 4, wherein said first and second lenses are the same size, and wherein said first and second sensors have the same number of pixels. 9. The method of claim 8, wherein said first and second lenses are less than 2 cm in diameter and wherein each of the first and second sensors support at least 8 Mpixels. 10. The method of claim 4, further comprising: receiving user input indicating a portion of the scene area to be focused in the first combined image; andwherein said processing said first, second, third and fourth images to generate a first combined image includes shifting pixel positions on at least one of said first, second, third and fourth images to align the portion of the first scene area to be focused. 11. The method of claim 10 wherein different shifts are used for different portions of the scene to create a single composite image. 12. The method of claim 1, wherein said fourth optical chain includes a fourth lens positioned in the fourth light path between the fourth mirror and the fourth sensor. 13. The method of claim 1, wherein operating a plurality of four or more optical chains includes: operating said first optical chain to capture said first image of said first portion of said first scene area;operating said second optical chain to capture said second image of said second portion of said first scene area;operating said third optical chain to capture said third image of said third portion said first scene area; andoperating said fourth optical chain to capture said fourth image of said fourth portion said first scene area. 14. The method of claim 1, wherein said first and second lenses are separate lenses; wherein light passing through said first aperture passes through said first lens; andwherein light passing through said second aperture passes through said second lens. 15. A camera apparatus for producing at least one image of a first scene area, comprising: a plurality of four or more optical chains that capture images of portions of the first scene area, said images including at least a first image of a first portion of said first scene area, a second image of a second portion of said first scene area, a third image of a third portion of said first scene area, and a fourth image of a fourth portion of said first scene area, said plurality of four or more optical chains including: i) a first optical chain, said first optical chain including a first mirror located in a first corner portion of said camera apparatus for redirecting light entering a first aperture located in a face of said camera apparatus along a first light path extending inside said camera apparatus from said first corner portion in a first direction along a first diagonal having a first angle with respect to a bottom of the camera device, said first direction extending towards a lower portion of said camera apparatus, said first optical chain including a first lens through which said first light path extends towards a first sensor included in said first optical chain;ii) a second optical chain including a second mirror located in a second corner portion of said camera apparatus for redirecting light entering a second aperture located in the face of said camera apparatus along a second light path extending inside said camera apparatus from said second corner portion in a second direction along a second diagonal having a second angle with respect to the bottom of the camera device, said second direction extending towards an upper portion of said camera apparatus, said second optical chain including a second lens through which said second light path extends towards a second sensor included in said second optical chain;iii) a third optical chain including a third mirror located in a third portion of said camera apparatus for redirecting light entering a third aperture located in the face of said camera apparatus along a third light path extending inside said camera apparatus in a third direction towards a third sensor included in said third optical chain; andiv) a fourth optical chain including a fourth mirror located in a fourth portion of said camera apparatus for redirecting light entering a fourth aperture located in the face of said camera apparatus along a fourth light path extending inside said camera apparatus in a fourth direction towards a fourth sensor included in said fourth optical chain, said first, second, third and fourth light paths extend in different directions; andan image processing module configured to process said first, second, third and fourth images to generate a first combined image of said first scene area. 16. The camera apparatus of claim 15, wherein the first mirror precedes the first lens along said first light path. 17. The camera apparatus of claim 16, wherein said fourth optical chain includes a fourth lens positioned in the fourth light path between the fourth mirror and the fourth sensor. 18. The camera apparatus of claim 16, wherein said image processing module is further configured to: receive a user input indicating a portion of the first scene area to be focused in the first combined image; andshift pixel positions on at least one of said first, second, third, and fourth images prior to generating said first combined image to align the portion of the first scene area to be focused, as part of said processing the first, second, third and fourth images to generate a first combined image. 19. The camera apparatus of claim 15, wherein said first and second light paths cross. 20. The camera apparatus of claim 19, wherein said first lens is less than 2 cm in diameter and wherein each of the first and second sensors support at least 8 Mpixels. 21. The camera apparatus of claim 15, wherein said first optical chain is configured to capture said first image of said first portion of said first scene area; wherein said second optical chain is configured to capture said second image of said second portion of said first scene area; andwherein said third optical chain is configured to capture said third image of said third portion of said first scene area; andwherein said fourth optical chain is configured to capture said fourth image of said fourth portion of said first scene area. 22. A computer readable medium including computer executable instructions which when executed by a processor control a camera apparatus to: operate a plurality of four or more optical chains to capture images of portions of a first scene area, said images including at least a first image of a first portion of said first scene area, a second image of a second portion of said first scene area, a third image of a third portion of said first scene area, and a fourth image of a fourth portion of said first scene area, operating the plurality of four or more optical chains including: i) operating a first optical chain to capture the first image of the first portion of the first scene area, the first optical chain including a first mirror located in a first corner portion of said camera apparatus for redirecting light entering a first aperture located in a face of said camera apparatus along a first light path extending inside said camera apparatus from said first corner portion in a first direction along a first diagonal having a first angle with respect to a bottom of the camera device, said first direction extending towards a lower portion of said camera apparatus, said first optical chain including a first lens through which said first light path extends towards a first sensor included in said first optical chain;ii) operating a second optical chain to capture the second image of the second portion the first scene area, the second optical chain including a second mirror located in a second corner portion of said camera apparatus for redirecting light entering a second aperture located in the face of said camera apparatus along a second light path extending inside said camera apparatus from said second corner portion in a second direction along a second diagonal having a second angle with respect to the bottom of the camera device, said second direction extending towards an upper portion of said camera apparatus, said second optical chain including a second lens through which said second light path extends towards a second sensor included in said second optical chain;iii) operating a third optical chain to capture the third image of the third portion of the first scene area, the third optical chain including a third mirror located in a third portion of said camera apparatus for redirecting light entering a third aperture located in the face of said camera apparatus along a third light path extending inside said camera apparatus in a third direction towards a third sensor included in said third optical chain; andiv) operating a fourth optical chain to capture the fourth image of the fourth portion of the first scene area, the fourth optical chain including a fourth mirror located in a fourth portion of said camera apparatus for redirecting light entering a fourth aperture located in the face of said camera apparatus along a fourth light path extending inside said camera apparatus in a fourth direction towards a fourth sensor included in said fourth optical chain, said first, second, third and fourth light paths extending in different directions; andprocess said first, second, third and fourth images to generate a first combined image of said first scene area.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (39)
Katayama Tatsushi,JPX ; Takiguchi Hideo,JPX ; Yano Kotaro,JPX ; Hatori Kenji,JPX, Apparatus and method for combining a plurality of images.
Watanabe, Makoto; Magaki, Yosuke; Nakazawa, Sachiko; Onumata, Yuichi, Camera, storage medium having stored therein camera control program, and camera control method.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for parallax detection and correction in images captured using array cameras that contain occlusions using subsets of images to perform depth estimation.
Kawamura Akira (Kanagawa JPX) Togawa Kazuo (Kanagawa JPX), Visual image display apparatus having a video display for one eye and a controllable shutter for the other eye.
Pulli, Kari; Shroff, Nitesh; Shroff, Sapna A., Methods and apparatus for compensating for motion and/or changing light conditions during image capture.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.