Methods and apparatus for capturing images using multiple camera modules in an efficient manner
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/247
H04N-005/232
H04N-005/225
G06T-007/292
출원번호
US-0693351
(2015-04-22)
등록번호
US-10075651
(2018-09-11)
발명자
/ 주소
Laroia, Rajiv
Shroff, Sapna A.
출원인 / 주소
Light Labs Inc.
대리인 / 주소
Straub & Straub
인용정보
피인용 횟수 :
0인용 특허 :
41
초록▼
Methods and apparatus for capturing images using a camera device including multiple camera modules, e.g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. Us
Methods and apparatus for capturing images using a camera device including multiple camera modules, e.g., multiple optical chains, in an efficient manner are described. Different camera devices in the camera device may capture images corresponding to different size fields of view of a scene area. User input is used to identify an object of interest. A first type camera module having a large field of view is used to track the identified object of interest. Sets of second type camera modules having a smaller field of view are used to capture images of the object of interest. Different sets of second type camera modules may be used at different times as a function of object of interest location. In some embodiments, at least some second type camera modules include the capability to adjust, e.g., move, image capture area, e.g., by changing a mirror angle inclination and/or a mirror rotation.
대표청구항▼
1. A method of operating a camera device comprising: receiving user input indicating an object of interest, said object of interest being at a first position when user input indicating the object of interest is received;identifying, based on the received user input, a first set of one or more first
1. A method of operating a camera device comprising: receiving user input indicating an object of interest, said object of interest being at a first position when user input indicating the object of interest is received;identifying, based on the received user input, a first set of one or more first type camera modules which should be used to capture an image of the object of interest, said identified first set of one or more first type camera modules including a first camera module including a first movable mirror, said step of identifying a first set of one or more first type camera modules including identifying said first camera module based on the field of view of said first camera module, said first camera module having a field of view which includes said first position or which can be adjusted to include said first position;tracking the position of the object of interest;controlling a position of said first moveable mirror of said first camera module to change based on the tracked position of the object of interest, controlling the position of said first moveable mirror including changing an angle of inclination of said first moveable mirror and rotating said first moveable mirror; andoperating the first camera module to capture an image of the object of interest; andwherein said first set of one or more first type camera modules includes a plurality of first type camera modules, each camera module of said plurality of first type camera modules being a camera module with a single moveable mirror that can be rotated and tilted. 2. The method of claim 1, further comprising: receiving user input indicating a size of an area surrounding the object of interest to be captured; andwherein identifying, based on the received user input, said first set of one or more first type camera modules which should be used to capture an image of the object of interest is further based on the size of the area surrounding the object of interest to be captured. 3. A method of operating a camera device comprising: receiving user input indicating an object of interest;identifying, based on the received user input, a first set of one or more first type camera modules which should be used to capture an image of the object of interest, said identified first set of one or more first type camera modules including a first camera module including a first movable mirror;tracking the position of the object of interest;controlling a position of said first moveable mirror of said first camera module to change based on the tracked position of the object of interest, controlling the position of said first moveable mirror including changing an angle of inclination of said first moveable mirror and rotating said first moveable mirror; andoperating the first camera module to capture an image of the object of interest;operating a second type camera module having a first field of view which is larger than a field of view of said first type camera modules to capture images of a scene area;detecting, based on images captured by the second type camera module a move of the object of interest from the first position to a new position; andbased on the new position, identifying a second set of one or more first type camera modules to be used to capture an image of the object of interest. 4. The method of claim 3, wherein identifying said second set of one or more first type camera modules includes identifying one or more first type camera modules having a field of view including the new position of the object of interest said second set of one or more first type camera modules including a second camera module. 5. The method of claim 4, further comprising: controlling a position of a second moveable mirror, said second moveable mirror being a moveable mirror in said second camera module, controlling the position of the second moveable mirror including moving the second moveable mirror based on the tracked change in the position of the object of interest to keep the object of interest in the field of view of said second camera module for a period of time. 6. The method of claim 5, wherein controlling the position of the second moveable mirror includes changing an angle of inclination of said second moveable mirror. 7. The method of claim 5, wherein controlling the position of the second moveable mirror includes changing an angle of inclination of said second moveable mirror and rotating said second moveable mirror to point the second moveable mirror in a different direction than a direction used to capture an image of the object of interest at the start of said period of time. 8. A camera device comprising: a plurality of camera modules;a module configured to receive user input indicating an object of interest, said object of interest being at a first position when user input indicating the object of interest is received;a module configured to identify, based on the received user input, a first set of one or more first type camera modules which should be used to capture an image of the object of interest, said identified first set of one or more first type camera modules including a first camera module including a first moveable mirror, said module configured to identify said first set of one or more first type camera modules including a module configured to identify said first camera module based on the field of view of the first camera module, said first camera module having a field of view which includes said first position or which can be adjusted to include said first position;a module configured to track the position of the object of interest;a module configured to control a position of said first moveable mirror of said first camera module to change based on the tracked position of the object of interest, controlling the position of the first moveable mirror including changing an angle of inclination of said first moveable mirror and rotating said first moveable mirror; anda module configured to control the first camera module to capture an image of the object of interest; andwherein said first set of one or more first type camera modules includes a plurality of first type camera modules, each camera module of said plurality of first type camera modules being a camera module with a single moveable mirror that can be rotated and tilted. 9. The camera device of claim 8, further comprising: a module configured to receive user input indicating a size of an area surrounding the object of interest to be captured; andwherein said module configured to identify said first set of one or more first type camera modules which should be used to capture an image of the object of interest is further configured to base the identification on the size of the area surrounding the object of interest to be captured. 10. A camera device comprising: a plurality of camera modules;a module configured to receive user input indicating an object of interest, said object of interest being at a first position when user input indicating the object of interest is received;a module configured to identify, based on the received user input, a first set of one or more first type camera modules which should be used to capture an image of the object of interest, said identified first set of one or more first type camera modules including a first camera module including a first moveable mirror, said module configured to identify said first set of one or more first type camera modules including a module configured to identify said first camera module based on the field of view of the first camera module, said first camera module having a field of view which includes said first position or which can be adjusted to include said first position;a module configured to track the position of the object of interest;a module configured to control a position of said first moveable mirror of said first camera module to change based on the tracked position of the object of interest, controlling the position of the first moveable mirror including changing an angle of inclination of said first moveable mirror and rotating said first moveable mirror; anda module configured to control the first camera module to capture an image of the object of interest;a module configured to control a second type camera module, having a first field of view which is larger than a field of view of said first type camera modules, to capture images of a scene area;a module configured to detect, based on images captured by the second type camera module a move of the object of interest from the first position to a new position; anda module configured to identify, based on the new position, a second set of one or more first type camera modules to be used to capture an image of the object of interest. 11. The camera device of claim 10, wherein said module configured to identify said second set of one or more first type camera modules includes: a module configured to identify one or more first type camera modules having a field of view including the new position of the object of interest, said identified one or more first type camera modules having a field of view including the new position of the object of interest including a second camera module; anda module configured to include said second camera module in said second set of one or more first type camera modules. 12. The camera device of claim 11, further comprising: a module configured control a position of a second moveable mirror, said second moveable mirror being a moveable mirror in said second camera module, to move based on the tracked change in the position of the object of interest to keep the object of interest in the field of view of said second camera module for a period of time. 13. The camera device of claim 12, wherein said module configured to control the position of the second moveable mirror includes: a module configured to change an angle of inclination of said second moveable mirror. 14. The camera device of claim 12, wherein said module configured to control the position of the second moveable mirror includes: a module configured to change an angle of inclination of said second moveable mirror and a rotation of said second moveable mirror to point the second moveable mirror in a different direction than a direction used to capture an image of the object of interest at the start of the period of time. 15. A non-transitory machine readable medium including processor executable instructions which when executed by a processor of a camera device, control the camera device to perform the steps of: receiving user input indicating an object of interest;identifying, based on the received user input, a first set of one or more first type camera modules which should be used to capture an image of the object of interest, said identified first set of one or more first type camera modules including a first camera module including a first movable mirror;tracking the position of the object of interest;controlling a position of said first moveable mirror of said first camera module to change based on the tracked position of the object of interest, controlling the position of said first moveable mirror including changing an angle of inclination of said first moveable mirror and rotating said first moveable mirror; andoperating the first camera module to capture an image of the object of interest;operating a second type camera module having a first field of view which is larger than a field of view of said first type camera modules to capture images of a scene area;detecting, based on images captured by the second type camera module a move of the object of interest from the first position to a new position; andidentifying, based on the new position, a second set of one or more first type camera modules to be used to capture an image of the object of interest.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (41)
Katayama Tatsushi,JPX ; Takiguchi Hideo,JPX ; Yano Kotaro,JPX ; Hatori Kenji,JPX, Apparatus and method for combining a plurality of images.
Watanabe, Makoto; Magaki, Yosuke; Nakazawa, Sachiko; Onumata, Yuichi, Camera, storage medium having stored therein camera control program, and camera control method.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Ciurea, Florian; Venkataraman, Kartik; Molina, Gabriel; Lelescu, Dan, Systems and methods for parallax detection and correction in images captured using array cameras that contain occlusions using subsets of images to perform depth estimation.
Kawamura Akira (Kanagawa JPX) Togawa Kazuo (Kanagawa JPX), Visual image display apparatus having a video display for one eye and a controllable shutter for the other eye.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.