최소 단어 이상 선택하여야 합니다.
최대 10 단어까지만 선택 가능합니다.
다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
NTIS 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
DataON 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
Edison 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
Kafe 바로가기국가/구분 | United States(US) Patent 등록 |
---|---|
국제특허분류(IPC7판) |
|
출원번호 | US-0515489 (2015-09-29) |
등록번호 | US-10250871 (2019-04-02) |
국제출원번호 | PCT/US2015/053013 (2015-09-29) |
국제공개번호 | WO2016/054089 (2016-04-07) |
발명자 / 주소 |
|
출원인 / 주소 |
|
대리인 / 주소 |
|
인용정보 | 피인용 횟수 : 0 인용 특허 : 309 |
Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the ima
Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.
1. A method of dynamically generating geometric calibration data for an array of cameras, comprising: acquiring a set of images of a scene using a plurality of cameras, where the set of images comprises a reference image and an alternate view image;detecting features in the set of images using a pro
1. A method of dynamically generating geometric calibration data for an array of cameras, comprising: acquiring a set of images of a scene using a plurality of cameras, where the set of images comprises a reference image and an alternate view image;detecting features in the set of images using a processor directed by an image processing application;identifying within the alternate view image features corresponding to features detected within the reference image using a processor directed by an image processing application;rectifying the set of images based upon a set of geometric calibration data using a processor directed by an image processing application;determining residual vectors for geometric calibration data at locations where features are observed within the alternate view image based upon observed shifts in locations of features identified as corresponding in the reference image and the alternate view image using a processor directed by an image processing application;determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors using a processor directed by an image processing application, wherein determining updated geometric calibration data comprises:using at least an interpolation process to generate a residual vector calibration field from the residual vectors;mapping the residual vector calibration field to a set of basis vectors; andgenerating a denoised residual vector calibration field using a linear combination of less than the complete set of basis vectors; andrectifying an image captured by the camera that captured the alternate view image based upon the updated geometric calibration data using a processor directed by an image processing application. 2. The method of claim 1, wherein determining residual vectors for geometric calibration data at locations where features are observed within the alternate view image comprises: estimating depths of features within the alternate view image identified as corresponding to features detected within the reference image based upon components of the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image along epipolar lines;determining scene dependent geometric corrections to apply to the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image based upon the estimated depths of the corresponding features; andapplying the scene dependent geometric corrections to the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image to obtain residual vectors for geometric calibration data at locations where features are observed within the alternate view image. 3. The method of claim 1, wherein determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors further comprises using an extrapolation process in the generation of the residual vector calibration field from the residual vectors. 4. The method of claim 1, further comprising applying the residual vector calibration field to the set of geometric calibration data with respect to the camera that captured the alternate view image. 5. The method of claim 1, wherein the set of basis vectors is learned from a training data set of residual vector calibration fields. 6. The method of claim 5, wherein the set of basis vectors is learned from a training data set of residual vector calibration fields using Principal Component Analysis. 7. The method of claim 1, wherein determining updated geometric calibration data for a camera that captured the alternate view image further comprises selecting an updated set of geometric calibration data from amongst a plurality of sets of geometric calibration data based upon at least the residual vectors for geometric calibration data at locations where features are observed within the alternate view image. 8. The method of claim 1, further comprising: acquiring an additional set of images of a scene using the plurality of cameras; anddetermining residual vectors for the geometric calibration data using the additional set of images;wherein determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors also comprises utilizing the residual vectors for the geometric calibration data determined using the additional set of images. 9. The method of claim 8, further comprising: detecting at least one region within a field of view of a camera that does not satisfy a feature density threshold;wherein the additional set of images of a scene is acquired in response to detecting that at least one region within a field of view of a camera does not satisfy the feature density threshold. 10. The method of claim 9, wherein utilizing the residual vectors determined using the additional set of images further comprises utilizing the residual vectors determined using the additional set of images to determine updated geometric calibration data with respect to the at least one region within the field of view of the camera in which the density threshold was not satisfied. 11. The method of claim 10, further comprising providing prompts via a user interface using a processor directed by an image processing application, where the prompts direct orientation of the camera array to shift locations of features identified as corresponding in the reference image and the alternate view image into the at least one region within the field of view of a camera that does not satisfy a feature density threshold during acquisition of the additional set of images. 12. A camera array, comprising: at least one array of cameras comprising a plurality of cameras;a processor; andmemory containing an image processing application;wherein the image processing application directs the processor to: acquire a set of images of a scene using the plurality of cameras, where the set of images comprises a reference image and an alternate view image;detect features in the set of images;identify within the alternate view image features corresponding to features detected within the reference image;rectify the set of images based upon a set of geometric calibration data;determine residual vectors for geometric calibration data at locations where features are observed within the alternate view image based upon observed shifts in locations of features identified as corresponding in the reference image and the alternate view image;determine updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors, wherein determining updated geometric calibration data comprises:using at least an interpolation process to generate a residual vector calibration field from the residual vectors;mapping the residual vector calibration field to a set of basis vectors; andgenerating a denoised residual vector calibration field using a linear combination of less than the complete set of basis vectors; andrectify an image captured by the camera that captured the alternate view image based upon the updated geometric calibration data. 13. The camera array of claim 12, wherein determining residual vectors for geometric calibration data at locations where features are observed within the alternate view image comprises: estimating depths of features within the alternate view image identified as corresponding to features detected within the reference image based upon components of the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image along epipolar lines;determining scene dependent geometric corrections to apply to the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image based upon the estimated depths of the corresponding features; andapplying the scene dependent geometric corrections to the observed shifts in locations of features identified as corresponding in the reference image and the alternate view image to obtain residual vectors for geometric calibration data at locations where features are observed within the alternate view image. 14. The camera array of claim 12, wherein determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors further comprises using an extrapolation process in the generation of the residual vector calibration field from the residual vectors. 15. The camera array of claim 12, wherein the image processing application further directs the processor to apply the residual vector calibration field to the set of geometric calibration data with respect to the camera that captured the alternate view image. 16. The camera array of claim 12, wherein the set of basis vectors is learned from a training data set of residual vector calibration fields. 17. The camera array of claim 16, wherein the set of basis vectors is learned from a training data set of residual vector calibration fields using Principal Component Analysis. 18. The camera array of claim 12, wherein determining updated geometric calibration data for a camera that captured the alternate view image further comprises selecting an updated set of geometric calibration data from amongst a plurality of sets of geometric calibration data based upon at least the residual vectors for geometric calibration data at locations where features are observed within the alternate view image. 19. The camera array of claim 12, wherein the image processing application further directs the processor to: acquire an additional set of images of a scene using the plurality of cameras; anddetermine residual vectors for the geometric calibration data using the additional set of images;wherein determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors also comprises utilizing the residual vectors for the geometric calibration data determined using the additional set of images. 20. The camera array of claim 19, wherein the image processing application further directs the processor to: detect at least one region within a field of view of a camera that does not satisfy a feature density threshold;wherein the additional set of images of a scene is acquired in response to detecting that at least one region within a field of view of a camera does not satisfy the feature density threshold. 21. The camera array of claim 20, wherein utilizing the residual vectors determined using the additional set of images further comprises utilizing the residual vectors determined using the additional set of images to determine updated geometric calibration data with respect to the at least one region within the field of view of the camera in which the density threshold was not satisfied. 22. A method of dynamically generating geometric calibration data for an array of cameras, comprising: acquiring a set of images of a scene using a plurality of cameras, where the set of images comprises a reference image and an alternate view image;detecting features in the set of images using a processor directed by an image processing application;identifying within the alternate view image features corresponding to features detected within the reference image using a processor directed by an image processing application;rectifying the set of images based upon a set of geometric calibration data using a processor directed by an image processing application;determining residual vectors for geometric calibration data at locations where features are observed within the alternate view image based upon observed shifts in locations of features identified as corresponding in the reference image and the alternate view image using a processor directed by an image processing application;determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors using a processor directed by an image processing application;rectifying an image captured by the camera that captured the alternate view image based upon the updated geometric calibration data using a processor directed by an image processing application;acquiring an additional set of images of a scene using the plurality of cameras;determining residual vectors for the geometric calibration data using the additional set of images, wherein determining updated geometric calibration data for a camera that captured the alternate view image based upon the residual vectors also comprises utilizing the residual vectors for the geometric calibration data determined using the additional set of images;detecting at least one region within a field of view of a camera that does not satisfy a feature density threshold;wherein the additional set of images of a scene is acquired in response to detecting that at least one region within a field of view of a camera does not satisfy the feature density threshold.wherein utilizing the residual vectors determined using the additional set of images further comprises utilizing the residual vectors determined using the additional set of images to determine updated geometric calibration data with respect to the at least one region within the field of view of the camera in which the density threshold was not satisfied; andproviding prompts via a user interface using a processor directed by an image processing application, where the prompts direct orientation of the camera array to shift locations of features identified as corresponding in the reference image and the alternate view image into the at least one region within the field of view of a camera that does not satisfy a feature density threshold during acquisition of the additional set of images.
Copyright KISTI. All Rights Reserved.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.