A dual-aperture zoom digital camera operable in both still and video modes. The camera includes Wide and Tele imaging sections with respective lens/sensor combinations and image signal processors and a camera controller operatively coupled to the Wide and Tele imaging sections. The Wide and Tele ima
A dual-aperture zoom digital camera operable in both still and video modes. The camera includes Wide and Tele imaging sections with respective lens/sensor combinations and image signal processors and a camera controller operatively coupled to the Wide and Tele imaging sections. The Wide and Tele imaging sections provide respective image data. The controller is configured to combine in still mode at least some of the Wide and Tele image data to provide a fused output image from a particular point of view, and to provide without fusion continuous zoom video mode output images, each output image having a given output resolution, wherein the video mode output images are provided with a smooth transition when switching between a lower zoom factor (ZF) value and a higher ZF value or vice versa, and wherein at the lower ZF the output resolution is determined by the Wide sensor while at the higher ZF value the output resolution is determined by the Tele sensor.
대표청구항▼
1. A dual-aperture digital camera for imaging an object or scene, comprising: a) a Wide camera comprising a Wide lens and a Wide image sensor, the Wide camera having a respective field of view FOVW and being operative to provide a Wide image of the object or scene;b) a Tele camera comprising a Tele
1. A dual-aperture digital camera for imaging an object or scene, comprising: a) a Wide camera comprising a Wide lens and a Wide image sensor, the Wide camera having a respective field of view FOVW and being operative to provide a Wide image of the object or scene;b) a Tele camera comprising a Tele lens and a Tele image sensor, the Tele camera having a respective field of view FOVT narrower than FOVW and being operative to provide a Tele image of the object or scene, wherein the Tele lens has a respective effective focal length EFLT and total track length TTLT fulfilling the condition EFLT/TTLT>1;c) a first autofocus (AF) mechanism coupled mechanically to, and used to perform an AF action on the Wide lens;d) a second AF mechanism coupled mechanically to, and used to perform an AF action on the Tele lens; ande) a camera controller operatively coupled to the first and second AF mechanisms and to the Wide and Tele image sensors and configured to control the AF mechanisms and to process the Wide and Tele images to create a fused image, wherein areas in the Tele image that are not focused are not combined with the Wide image to create the fused image and wherein the camera controller is further operative to output the fused image with a point of view (POV) of the Wide camera by mapping Tele image pixels to matching pixels within the Wide image. 2. The dual-aperture digital camera of claim 1, wherein the camera controller is further configured to perform rectification of the Wide and Tele images by aligning these images to be on an approximately epipolar line to obtain rectified Wide and Tele images. 3. The dual-aperture digital camera of claim 2, wherein the camera controller is further configured to perform mapping between the rectified Wide and Tele images to produce a registration map. 4. The dual-aperture digital camera of claim 3, wherein the camera controller is further configured to perform resampling of the Tele image according to the registration map to provide a re-sampled Tele image. 5. The dual-aperture digital camera of claim 4, wherein the camera controller is further configured to process the re-sampled Tele image and the Wide image to detect an error in the registration and to provide a decision output. 6. The dual-aperture digital camera of claim 5, wherein, if an error is detected, the camera controller is further configured to choose Wide pixel values to be used in the output image for pixels that caused the error. 7. The dual-aperture digital camera of claim 6, wherein the Wide and Tele image sensors have pixels with identical pixel counts and with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is equal to Pixel sizeTele, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, and wherein the camera controller is further configured to synchronize the Wide and Tele image sensors to start exposure at the same time. 8. The dual-aperture digital camera of claim 6, wherein the Wide and Tele image sensors have pixels with identical pixel counts and with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is not equal to Pixel sizeTele, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, and wherein the camera controller is further configured to synchronize the Wide and Tele image sensors to start exposure at the same time. 9. The dual-aperture digital camera of claim 6, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele and wherein Pixel sizeWide is not equal to Pixel sizeTele, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, and wherein the camera controller is further configured to synchronize the Wide and Tele image sensors to start exposure at the same time. 10. The dual-aperture digital camera of claim 1, wherein the Wide and Tele image sensors have pixels with identical pixel counts. 11. The dual-aperture digital camera of claim 10, wherein the pixel count is 12 MP. 12. The dual-aperture digital camera of claim 1, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele and wherein Pixel sizeWide is equal to Pixel sizeTele. 13. The dual-aperture digital camera of claim 1, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele and wherein Pixel sizeWide is not equal to Pixel sizeTele. 14. The dual-aperture digital camera of claim 1, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele. 15. The dual-aperture digital camera of claim 14, wherein the camera controller is further configured to synchronize scanning of the Wide and Tele image sensors such that matching FOVs in the Wide and Tele images are scanned at the same time. 16. The dual-aperture digital camera of claim 14, wherein the camera controller is further configured to synchronize the Wide and Tele image sensors to start exposure at the same time. 17. The dual-aperture digital camera of claim 1, wherein the Wide and Tele lenses have respective F numbers F#Wide and F#Tele and wherein the camera controller is further configured to set respective Wide and Tele image sensor exposure times ETWide and ETTele to fulfill the condition ETTele=ETWide×(F#Tele/F#Wide)2×(Pixel sizeWide/Pixel sizeTele)2. 18. The dual-aperture digital camera of claim 1, wherein the Wide and Tele lenses have respective F numbers F#Wide and F#Tele and wherein the camera controller is further configured to set respective Wide and Tele image sensor exposure times ETWide and ETTele to be equal. 19. A dual-aperture digital camera for imaging an object or scene, comprising: a) a Wide camera comprising a Wide lens and a Wide image sensor, the Wide camera having a respective field of view FOVW and being operative to provide a Wide image of the object or scene;b) a Tele camera comprising a Tele lens and a Tele image sensor, the Tele camera having a respective field of view FOVT narrower than FOVW and being operative to provide a Tele image of the object or scene, wherein the Tele lens has a respective effective focal length EFLT and total track length TTLT fulfilling the condition EFLT/TTLT>1;c) a first autofocus (AF) mechanism coupled mechanically to, and used to perform an AF action on the Wide lens;d) a second AF mechanism coupled mechanically to, and used to perform an AF action on the Tele lens, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is not equal to Pixel sizeTele, and wherein the Tele camera has a Tele camera depth of field (DOFT) shallower than a DOF of the Wide camera (DOFW); ande) a camera controller operatively coupled to the first and second AF mechanisms and to the Wide and Tele image sensors and configured to control the AF mechanisms, to process the Wide and Tele images to find translations between matching points in the images to calculate depth information and to create a fused image suited for portrait photos, the fused image having a DOF shallower than DOFT and having a blurred background. 20. The dual-aperture digital camera of claim 19, wherein the Tele lens includes five lens elements along an optical axis from an object side to an image side, starting from the object side with a first lens element with positive power, a second lens element with negative power, a fourth lens element with negative power and a fifth lens element, wherein the largest distance between consecutive lens elements along the optical axis is a distance between the fourth lens element and the fifth lens element. 21. The dual-aperture digital camera of claim 20, wherein the fused image having a DOF shallower than DOFT is output as a portrait photo similar to a portrait photo taken with a digital single-lens reflex (DSLR) camera. 22. The dual-aperture digital camera of claim 21, wherein the DSLR has a focal length between 50-80 mm. 23. A method comprising: a) providing a dual-camera comprising a Wide camera and a Tele camera, the Wide and Tele cameras having respective Wide and Tele lenses, Wide and Tele image sensors and Wide and Tele fields of view FOVW and FOVT, wherein FOVT is narrower than FOVW, wherein the Tele lens has a respective effective focal length EFLT and total track length TTLT fulfilling the condition EFLT/TTLT>1;b) acquiring a Wide image with the Wide sensor and a Tele image with the Tele sensor;c) processing the Wide and Tele images to create a fused image, wherein areas in the Tele image that are not focused are not combined with the Wide image to create the fused image; andd) outputting the fused image with a point of view (POV) of the Wide camera by mapping Tele image pixels to matching pixels within the Wide image. 24. The method of claim 23, further comprising rectifying the Wide and Tele images by aligning these images to be on an approximately epipolar line to obtain rectified Wide and Tele images. 25. The method of claim 24, further comprising mapping between the rectified Wide and Tele images to produce a registration map. 26. The method of claim 25, further comprising resampling the Tele image according to the registration map to provide a re-sampled Tele image. 27. The method of claim 26, further comprising processing the re-sampled Tele image and the Wide image to detect an error in the registration and to provide a decision output. 28. The method of claim 27, wherein if an error is detected, further comprising choosing Wide pixel values to be used in the output image for those pixels that caused the error. 29. The method of claim 28, wherein the Wide and Tele image sensors have pixels with identical pixel counts and with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is equal to Pixel sizeTele and wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, the method further comprising synchronizing the Wide and Tele image sensors to start exposure at the same time. 30. The method of claim 28, wherein the Wide and Tele image sensors have pixels with identical pixel counts and with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is not equal to Pixel sizeTele and wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, the method further comprising synchronizing the Wide and Tele image sensors to start exposure at the same time. 31. The method of claim 28, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele wherein Pixel sizeWide is not equal to Pixel sizeTele and wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele, the method further comprising synchronizing the Wide and Tele image sensors to start exposure at the same time. 32. The method of claim 23, wherein the Wide and Tele image sensors have pixels with identical pixel counts. 33. The method of claim 32, wherein the pixel count is 12 MP. 34. The method of claim 23, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele and wherein Pixel sizeWide is equal to Pixel sizeTele. 35. The method of claim 23, wherein the Wide and Tele image sensors have pixels with respective pixel sizes Pixel sizeWide and Pixel sizeTele and wherein Pixel sizeWide is not equal to Pixel sizeTele. 36. The method of claim 23, wherein the Wide and Tele lenses have different F numbers F#Wide and F#Tele. 37. The method of claim 36, further comprising synchronizing scanning of the Wide and Tele image sensors such that matching FOVs in the Wide and Tele images are scanned at the same time. 38. The method of claim 36, further comprising synchronizing the Wide and Tele image sensors to start exposure at the same time. 39. The method of claim 23, wherein the Wide and Tele lenses have respective F numbers F#Wide and F#Tele, the method further comprising setting respective Wide and Tele image sensor exposure times ETWide and ETTele to fulfill the condition ETTele=ETWide×(F#Tele/F#Wide)2×(Pixel sizeWide/Pixel sizeTele)2. 40. The method of claim 23, wherein the Wide and Tele lenses have respective F numbers F#Wide and F#Tele, the method further comprising setting respective Wide and Tele image sensor exposure times ETWide and ETTele to be equal.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (159)
Munger, Rejean J. Y. B.; Hilkes, Robert G.; Perron, Marc; Sohi, Nirmal, Apparatus and method for a dynamic “region of interest” in a display system.
Labaziewicz,Peter; Janson, Jr.,Wilbert F.; Parulski,Kenneth A., Compact image capture assembly using multiple lenses and image sensors to provide an extended zoom range.
Malone, Michael R.; Nave, Pierre Henri Rene Della; Brading, Michael Charles; Lee, Jess Jan Young; Tian, Hui; Ivanov, Igor Constantin; Sargent, Edward Hartley, Devices and methods for high-resolution image and video capture.
Deever, Aaron T.; Parulski, Kenneth A.; Fredlund, John R.; Rabbani, Majid; Kurtz, Andrew F.; Manico, Joseph A., Digital camera using multiple image sensors to provide improved temporal sampling.
Labaziewicz,Peter; Janson, Jr.,Wilbert F.; Parulski,Kenneth A., Digital camera using multiple lenses and image sensors to provide an extended zoom range.
Labaziewicz,Peter; Janson, Jr.,Wilbert F.; Parulski,Kenneth A., Digital camera using multiple lenses and image sensors to provide an extended zoom range.
Hanna, Keith James; Burt, Peter J.; Peleg, Shmuel; Dixon, Douglas F.; Mishra, Deepam; Wixson, Lambert E.; Mandlebaum, Robert; Coyle, Peter; Herman, Joshua R., Fully automated iris recognition system utilizing wide and narrow fields of view.
Lelong Pierre (Nogent/Sur/Marne FRX) Dalm Govert (Veldhoven NLX) Klijn Jan (Breda NLX), Image processing method and device for constructing an image from adjacent images.
Amano Yoshinori (Takatsuki JPX) Kato Misao (Katano JPX) Hirauchi Yoshio (Osaka JPX) Kimura Mari (Kishiwada JPX), Image processor for producing cross-faded image from first and second image data.
Furlan, John L. W.; Driscoll, Jr., Edward C.; Hoffman, Robert G.; Fluker, Derek; Bechtel, Karen L.; Shiffer, Katerina L.; Garimella, Venugopal; Curtis, Daniel B., Method and system for generation of multiple viewpoints into a scene viewed by motionless cameras and for presentation of a view path.
Goldenberg, Ephraim; Shabtay, Gal; Avivi, Gal; Dror, Michael; Bachar, Gil; Yedid, Itay; Jerby, Itay, Method and system for providing auto focus and optical image stabilization in a compact folded camera.
Turkowski Kenneth E. ; Shum Heng-Yeung, Method and system for simulating motion in a computer graphics application using image registration and view interpolat.
Bender Walter R. (Auburndale MA) Teodosio Laura A. (Derby CT), Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method.
Silverstein, D. Amnon; Go, Shun Wai; Lim, Suk Hwan; Millet, Timothy J.; Chen, Ting; Ni, Bin, Modeless video and still frame capture using interleaved frames of video and still resolutions.
Ravirala, Narayana Karthik; Liu, Shizhong; Shanmugavadivelu, Karthikeyan; Dayana, Venkata Ravi Kiran, Systems and methods for power optimization for imaging devices with dual cameras.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.