Methods and apparatus for controlling the read out of rows of pixel values from sensors corresponding to different optical chains used to capture portions of the same image area are described. The readout is controlled based on user input and/or determinations with regard to the rate of motion in ca
Methods and apparatus for controlling the read out of rows of pixel values from sensors corresponding to different optical chains used to capture portions of the same image area are described. The readout is controlled based on user input and/or determinations with regard to the rate of motion in captured images or portions of captured images. For a low rate of motion i, the readout rate of a sensor corresponding to a small focal length is slowed down while the pixel row readout rate of one or more sensors corresponding to one or more optical chains have larger focal lengths are allowed to proceed at a normal rate. For a high rate of motion, the read out rate of the sensor corresponding to the optical chain having the smaller focal length is allowed to proceed at the normal rate.
대표청구항▼
1. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is a smaller focal length than a second focal length of said second
1. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is a smaller focal length than a second focal length of said second optical chain, the method comprising: making a decision based on user input whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor, said user input indicating a high rate of motion mode of operation or a high resolution mode of operation, said step of making a decision is based on user input including: i) deciding to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor when the user input indicates selection of a high rate of motion mode of operation; andii) deciding to perform individual readouts of consecutive rows of pixel elements of said second sensor when the user input indicates selection of a high resolution mode of operation;controlling the first sensor to read out pixel values of said first sensor; andcontrolling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor. 2. The method of claim 1, wherein controlling the second sensor to read out pixel values includes controlling the second sensor to read out pixel values in parallel with the readout of at least some pixel values of said first sensor. 3. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is smaller than a second focal length of said second optical chain, the method comprising: making a decision based on at least one of: i) user input or ii) a determined rate of motion whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;controlling the first sensor to read out pixel values of said first sensor; andcontrolling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor,wherein said step of making a decision is based on a rate of motion, said step of making a decision including: i) deciding to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor when the rate of motion is above a first threshold; andii) deciding to perform individual readouts of consecutive rows of pixel elements of said second sensor when the rate of motion is below said first threshold. 4. The method of claim 3, further comprising: determining said rate of motion from images sequentially captured by an optical chain of said camera device. 5. The method of claim 4, wherein said determining includes determining the rate of motion based on differences between an image captured during a first time period and an image captured during a second time period which follows said first time period. 6. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is smaller than a second focal length of said second optical chain, the method comprising: making a decision based on at least one of: i) user input or ii) a determined rate of motion whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;controlling the first sensor to read out pixel values of said first sensor;controlling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; andcontrolling a third sensor corresponding to a third optical chain having the same focal length as said second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows when said decision is a decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor, said third sensor being controlled to jointly read out at least some rows of pixel values after the readout of said second sensor has been completed but prior to completion of the readout of the first sensor. 7. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is smaller than a second focal length of said second optical chain, the method comprising: making a decision based on at least one of: i) user input or ii) a determined rate of motion whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;controlling the first sensor to read out pixel values of said first sensor; andcontrolling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; andwhen said decision is a decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor, controlling the number of rows of pixel elements to be read out in a joint read as a function of the ratio of the first focal length to the second focal length. 8. A method of capturing images using a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is smaller than a second focal length of said second optical chain, the method comprising: making a decision based on at least one of: i) user input or ii) a determined rate of motion whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;controlling the first sensor to read out pixel values of said first sensor; andcontrolling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; andcontrolling the first sensor to read out pixel values of pixel elements of said first sensor at a rate which is a function of the ratio of the second focal length to the first focal length when said decision is a decision to perform individual readouts of consecutive rows of pixel elements of said second sensor. 9. A camera device comprising: a first optical chain including a first sensor and having a first focal length;a second optical chain including a second sensor and having a second focal length, said first focal length being smaller than said second focal length;a readout control decision module configured to make a readout control decision, based on at least one of: i) user input or ii) a determined rate of motion, whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;a user input interface configured to receive user input indicating an automatic mode of operation, a high rate motion mode of operation or a high resolution mode of operation; a mode control module configured to set the camera device in a mode of operation in response to received user input; a sensor readout control module configured to: i) control the first sensor to read out pixel values of said first sensor; andii) control the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said readout control decision; andwherein said readout control decision module is configured to make said decision based on a rate of motion detected in images captured by said camera device when received user input indicates an automatic mode of operation. 10. The camera device of claim 9, wherein said sensor readout control module controls the second sensor to read out pixel values in parallel with the readout of at least some pixel values of said first sensor, as part of controlling the second sensor to read out pixel values. 11. A camera device comprising: a first optical chain including a first sensor and having a first focal length;a second optical chain including a second sensor and having a second focal length, said first focal length being smaller than said second focal length;a readout control decision module configured to make a readout control decision, based on at least one of: i) user input or ii) a determined rate of motion, whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor, the readout control decision module being configured to: i) decide to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor when the rate of motion is above a first threshold; andii) decide to perform individual readouts of consecutive rows of pixel elements of said second sensor when the rate of motion is below said first threshold; anda sensor readout control module configured to: i) control the first sensor to read out pixel values of said first sensor; andii) control the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said readout control decision. 12. The camera device of claim 11, further comprising: a motion rate determination module configured to determine said rate of motion from images sequentially captured by an optical chain of said camera device. 13. The camera device of claim 12, wherein said motion rate determination module determines the rate of motion based on differences between an image captured during a first time period and an image captured during a second time period which follows said first time period. 14. A camera device comprising: a first optical chain including a first sensor and having a first focal length;a second optical chain including a second sensor and having a second focal length, said first focal length being smaller than said second focal length;a readout control decision module configured to make a readout control decision, based on at least one of: i) user input or ii) a determined rate of motion, whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; anda sensor readout control module configured to: i) control the first sensor to read out pixel values of said first sensor;ii) control the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said readout control decision, andiii) control a third sensor corresponding to a third optical chain having the same focal length as said second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows when said decision is a decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor, said third sensor being controlled to jointly read out at least some rows of pixel values after the readout of said second sensor has been completed but prior to completion of the readout of the first sensor. 15. A camera device comprising: a first optical chain including a first sensor and having a first focal length;a second optical chain including a second sensor and having a second focal length, said first focal length being smaller than said second focal length;a readout control decision module configured to make a readout control decision, based on at least one of: i) user input or ii) a determined rate of motion, whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; anda sensor readout control module configured to: i) control the first sensor to read out pixel values of said first sensor;ii) control the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said readout control decision, anda joint readout control module configured to control the number of rows of pixel elements to be read out in a joint read as a function of the ratio of the first focal length to the second focal length when said decision is a decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor. 16. A non-transitory machine readable medium including processor executable instructions which when executed by a processor of a camera device including at least a first optical chain including a first sensor and a second optical chain including a second sensor, said first optical chain having a first focal length which is smaller than a second focal length of said second optical chain, control the camera device to perform the steps of: making a decision based on at least one of: i) user input or ii) a determined rate of motion whether to control the second sensor of the second optical chain to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor;controlling the first sensor to read out pixel values of said first sensor;controlling the second sensor to read out pixel values of pixel elements of said second sensor in accordance with the said decision to perform joint readouts of pixel elements corresponding to consecutive pixel element rows of the second sensor or to perform individual readouts of consecutive rows of pixel elements of said second sensor; andcontrolling the first sensor to read out pixel values of pixel elements of said first sensor at a rate which is a function of the ratio of the second focal length to the first focal length when said decision is a decision to perform individual readouts of consecutive rows of pixel elements of said second sensor.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (39)
Katayama Tatsushi,JPX ; Takiguchi Hideo,JPX ; Yano Kotaro,JPX ; Hatori Kenji,JPX, Apparatus and method for combining a plurality of images.
Watanabe, Makoto; Magaki, Yosuke; Nakazawa, Sachiko; Onumata, Yuichi, Camera, storage medium having stored therein camera control program, and camera control method.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for parallax detection and correction in images captured using array cameras that contain occlusions using subsets of images to perform depth estimation.
Kawamura Akira (Kanagawa JPX) Togawa Kazuo (Kanagawa JPX), Visual image display apparatus having a video display for one eye and a controllable shutter for the other eye.
Pulli, Kari; Shroff, Nitesh; Shroff, Sapna A., Methods and apparatus for compensating for motion and/or changing light conditions during image capture.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.