Focusing mechanisms for compressive imaging device
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/228
G03B-013/36
출원번호
US-0208263
(2011-08-11)
등록번호
US-8717492
(2014-05-06)
발명자
/ 주소
McMackin, Lenore
Hewitt, Donna E.
Weston, Tyler H.
Zollars, Byron
출원인 / 주소
InView Technology Corporation
대리인 / 주소
Meyertons Hood Kivlin Kowert & Goetzel, P.C.
인용정보
피인용 횟수 :
8인용 특허 :
7
초록▼
A compressive imaging (CI) device including a light modulator and a light sensor (e.g., a single-element sensor or a sensor array). The CI device may support the focusing of light on the light modulator and/or on the light sensor in a number of ways: (1) determining a focus indicator value by analyz
A compressive imaging (CI) device including a light modulator and a light sensor (e.g., a single-element sensor or a sensor array). The CI device may support the focusing of light on the light modulator and/or on the light sensor in a number of ways: (1) determining a focus indicator value by analyzing a 1D or 2D image in the incident light field; (2) measuring light spillover between modulator regions and light sensing elements—either at the level of voltage measurements or the level of reconstructed images; (3) measure noise in reconstructed sub-images; (4) measuring an amount high-frequency content in the incident light field; (5) incorporating a range finder to measure distance to the object being imaged; (6) incorporating an image sensor downstream from the modulator; and (7) splitting a portion of the incident light onto an image sensor, prior to the modulator.
대표청구항▼
1. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) the light modulation unit modulating an in
1. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) the light modulation unit modulating an incident light stream with the sequence of spatial patterns to produce a modulated light stream, wherein each of the spatial patterns is restricted to a subset of the array of light modulating elements;(c) a light sensing device of the CI device receiving the modulated light stream and acquiring a sequence of samples representing an intensity of the modulated light stream as a function of time, wherein the sequence of samples includes at least one sample for each of the spatial patterns;(d) constructing an image using the sequence of spatial patterns and the acquired samples;(e) computing a focus indicator value based on the image, wherein the focus indicator value indicates an extent to which the incident light stream is in focus at the light modulation unit. 2. The method of claim 1, wherein the subset of the array of light modulating elements is a convex region located at the center of the array of light modulating elements. 3. The method of claim 1, wherein the CI device includes an optical subsystem that receives and operates on the incident light stream prior to the incident light stream arriving at the light modulation unit. 4. The method of claim 3, further comprising: changing a focus setting of the optical subsystem based on data including the focus indicator value. 5. The method of claim 4, further comprising repeatedly performing a set of operations that includes: changing a focus setting of the optical subsystem; and performing (a), (b), (c), (d) and (e), wherein the set of operations is repeated until the focus indicator value becomes less than a threshold value. 6. The method of claim 3, further comprising: changing an optical distance between the optical subsystem and the light modulation unit based on data including the focus indicator value. 7. The method of claim 3, further comprising repeatedly performing a set of operations that includes: changing an optical distance between the optical subsystem and the light modulation unit; and performing (a), (b), (c), (d) and (e), wherein the set of operations is repeated until the focus indicator value becomes less than a threshold value. 8. The method of claim 7, further comprising: changing an optical distance between the light modulation unit and the light sensing device based on a final distance between the optical subsystem and the light modulation unit after the focus indicator value becomes less than the threshold value. 9. The method of claim 3, further comprising: directing an actuator to change an optical distance between the optical subsystem and the light modulation unit according to a first displacement value;performing (a) through (e) a second time, to obtain an additional image and a focus indicator value for the additional image;computing a second displacement value for the optical distance based on data including the focus indicator value for the image, the focus indicator value for the additional image and the first displacement value. 10. The method of claim 9, further comprising: directing the actuator to change the optical distance according to the second displacement value. 11. The method of claim 3, further comprising: directing an actuator to change a focus setting of the optical subsystem according to a first displacement value;performing (a) through (e) a second time, to obtain an additional image and a focus indicator value for the additional image;computing a second displacement value for the focus setting based on data including the focus indicator value for the image, the focus indicator value for the additional image and the first displacement value. 12. The method of claim 11, further comprising: directing the actuator to change the focus setting of the optical subsystem according to the second displacement value. 13. The method of claim 3, further comprising: directing an actuator to change an optical distance between the optical subsystem and the light modulation unit through a range of distances;performing (a) through (e) for each of a plurality of distances within the range in order to obtain a corresponding plurality of images and a corresponding plurality of focus indicator values;determining an optimal value for the optical distance based on an analysis of data including the plurality of focus indicator values. 14. The method of claim 13, further comprising: directing the actuator to change the optical distance between the optical subsystem and the light modulation unit to the optimal value. 15. The method of claim 3, further comprising: directing an actuator to change the focus setting of the optical subsystem through a range of settings;performing (a) through (e) for each of a plurality of focus settings within the range in order to obtain a corresponding plurality of images and a corresponding plurality of focus indicator values; anddetermining an optimal value for the focus setting based on an analysis of data including the plurality of focus indicator values. 16. The method of claim 15, further comprising: directing the actuator to change the focus setting to the optimal value. 17. The method of claim 1, wherein the light sensing device includes only one light sensing element. 18. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device;(b) the light modulation unit modulating an incident light stream with the sequence of spatial patterns to produce a modulated light stream;(c) acquiring a sequence of the frames from an array of light sensing elements of the CI device, wherein each of the light sensing elements receives a respective spatial portion of the modulated light stream, wherein each of the frames corresponds to respective one of the spatial patterns, wherein each of the frames includes one sample from each of the light sensing elements;(d) determining a sequence of sum values, wherein each of the sum values is determined by adding the samples in a respective one of the frames of the acquired sequence;(e) constructing an image using the sequence of spatial patterns and the sequence of sum values;(f) computing a focus indicator value based on the image, wherein the focus indicator value indicates an extent to which the incident light stream is in focus at the light modulation unit. 19. A method for focusing a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with calibration patterns to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, where the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each electrical signal represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions within the array of light modulating elements, wherein each of the calibration patterns specifies that the light modulating elements inside a respective one of the regions are to be set to an off state and specifies that at least a subset of the light modulating elements outside the respective region are to be set to an on state;(c) for each of the calibration patterns, acquiring a respective group of samples from the array of light sensing elements, wherein each of the sample groups includes at least one sample of each of the electrical signals;(d) determining spillover values corresponding respectively to the calibration patterns, wherein each of the spillover values is determined based on the sample group corresponding to the respective calibration pattern, wherein each of the spillover values indicates an extent to which modulated light from outside the respective region of the array of light modulating elements reaches the light sensing element corresponding to the respective region;(e) computing a composite spillover value for the array of light sensing elements based on the spillover values. 20. The method of claim 19, further comprising: directing an actuator to change an optical distance between the light modulation unit and the array of light sensing elements based on data including the composite spillover value. 21. The method of claim 19, further comprising repeatedly performing a set of operations that includes: changing an optical distance between the light modulation unit and the array of light sensing elements; and performing (a) through (e), wherein the set of operations is repeated until the composite spillover value becomes less than a threshold value. 22. The method of claim 19, further comprising: directing an actuator to change an angle of orientation of the array of light modulating elements based on data including the composite spillover value. 23. The method of claim 19, further comprising repeatedly performing a set of operations that includes: changing an angle of orientation of the array of light sensing elements; and performing (a) through (e), wherein the set of operations is repeated until the composite spillover value becomes less than a threshold value. 24. The method of claim 19, wherein each of the calibration patterns specifies that all the light modulating elements outside the respective region are to take the ON state. 25. The method of claim 19, further comprising: directing an actuator to change an optical distance between the light modulation unit and the array of light sensing elements according to a first displacement value;performing (a) through (e) a second time, to obtain an additional composite spillover value;computing a second displacement value for the optical distance between the light modulation unit and the array of light sensing elements based on data including the composite spillover value, the additional composite spillover value and the first displacement value. 26. The method of claim 25, further comprising: directing the actuator to change the optical distance between the light modulation unit and the array of light sensing elements according to the second displacement value. 27. The method of claim 19, further comprising: directing an actuator to change an angle of orientation of the array of light sensing elements according to a first displacement value;performing (a) through (e) a second time, to obtain an additional composite spillover value;computing a second displacement value for the angular orientation based on data including the composite spillover value, the additional composite spillover value and the first displacement value. 28. The method of claim 27, further comprising: directing the actuator to change the angle of orientation of the array of light sensing elements according to the second displacement value. 29. The method of claim 19, further comprising: directing an actuator to change an optical distance between the light modulation unit and the array of light sensing elements through a range of distances;performing (a) through (e) for each of a plurality of optical distances within the range in order to obtain a corresponding plurality of composite spillover values;determining an optimal value for the optical distance based on an analysis of data including the plurality of composite spillover values. 30. The method of claim 29, further comprising: directing the actuator to change the optical distance to the optimal value. 31. The method of claim 19, further comprising: directing an actuator to change an orientation angle of the array of light sensing elements through a range of angles;performing (a) through (e) for each of a plurality of angles within the range in order to obtain a corresponding plurality of composite spillover values;determining an optimal value for the angle based on an analysis of data including the plurality of composite spillover values. 32. The method of claim 31, further comprising: directing the actuator to change the angular orientation to the optimal value. 33. A method for focusing a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with a calibration pattern to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, where the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each electrical signal represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions within the array of light modulating elements, wherein the calibration pattern specifies that the light modulating elements inside a first one of the regions are to be set to an off state and specifies that at least a subset of the light modulating elements outside the first region are to be set to an on state, wherein the first region corresponds to a first of the light sensing elements;(c) acquiring samples of the electrical signal generated by the first light sensing element in response to said modulating the incident light stream with the calibration pattern, wherein each of the samples indicates an extent to which modulated light from outside the first region of the array of light modulating elements reaches the first light sensing element. 34. A method for determining focus-related information for a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with a sequence of spatial patterns to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, wherein the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each of the electrical signals represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions of the array of light modulating elements;(c) acquiring measurements from the array of light sensing elements, wherein the measurements include sample sets that correspond respectively to the light sensing elements, wherein each sample set includes samples of the electrical signal generated by the respective light sensing element, with the samples including at least one sample for each of the spatial patterns;(d) computing a focus indicator value based on two or more noise values for two or more respective ones of the light sensing devices, wherein the focus indicator value indicates an extent to which the modulated light stream is in focus at the sensor array, wherein each of the two or more noise values is computed by: constructing a respective sub-image based on the sample set of the respective light sensing element and also on a restriction of the spatial patterns to the region of the array of light modulating elements corresponding to the respective light sensing element; andcomputing an amount of noise present in the respective sub-image. 35. The method of claim 34, further comprising: determining a displacement value for the array of light sensing elements based on data including the focus indicator value; and directing the array of light sensing elements to be translated according to the displacement value. 36. The method of claim 34, further comprising: determining an angular displacement value for the array of light sensing elements based on data including the focus indicator value; and directing the array of light sensing elements to be rotated according to the angular displacement value. 37. The method of claim 34, further comprising: changing an optical distance between the light modulation unit and the array of light sensing elements; and performing said changing and the operations (a) through (d) one or more times until the focus indicator value is optimized. 38. The method of claim 34, further comprising: changing an angular orientation of the array of light sensing elements; and performing said changing and the operations (a) through (d) one or more times until the focus indicator value is optimized. 39. A method for determining focus-related information for a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with a sequence of spatial patterns to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, wherein the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each of the electrical signals represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions of the array of light modulating elements;(c) acquiring a set of samples from a first of the light sensing elements, wherein the sample set includes samples of the electrical signal generated by the first light sensing element, with the samples including at least one sample for each of the spatial patterns;(d) computing a focus indicator value for the first light sensing device, wherein the focus indicator value indicates an extent to which the modulated light stream is in focus at the sensor array, wherein the focus indicator value is computed by: constructing a sub-image based on the sample set and on a restriction of the spatial patterns to a the region of the array of light modulating elements corresponding to the first light sensing element; andcomputing an amount of noise present in the sub-image. 40. A method for determining focus-related information for a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with a sequence of spatial patterns to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, wherein the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each of the electrical signals represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions on the array of light modulating elements;(c) acquiring measurements from the array of light sensing elements, wherein the measurements include sample sets that correspond respectively to the light sensing elements, wherein each sample set includes samples of the electrical signal generated by the respective light sensing element, with the samples including at least one sample for each of the spatial patterns;(d) computing a focus indicator value based on two or more spillover values for two or more respective ones of the light sensing devices, wherein the focus indicator value indicates an extent to which the modulated light stream is in focus at the sensor array, wherein each of the two or more spillover values is computed by: constructing a respective image based on the sample set of the respective light sensing element and also on the spatial patterns;summing pixels in the image outside the region corresponding to the respective light sensing element. 41. A method for determining focus-related information for a compressive imaging (CI) device, the method comprising: (a) modulating an incident light stream with a sequence of spatial patterns to obtain a modulated light stream, wherein said modulating is performed by a light modulation unit of the CI device, wherein the light modulation unit includes an array of light modulating elements;(b) an array of light sensing elements of the CI device receiving the modulated light stream, wherein the light sensing elements receive respective spatial portions of the modulated light stream and generate respective electrical signals, wherein each of the electrical signals represents intensity of the respective spatial portion as a function of time, wherein the light sensing elements correspond to respective non-overlapping regions on the array of light modulating elements;(c) acquiring measurements from the array of light sensing elements, wherein the measurements include sample sets that correspond respectively to the light sensing elements, wherein each sample set includes samples of the electrical signal generated by the respective light sensing element, with the samples including at least one sample for each of the spatial patterns;(d) computing a spillover value for a first of the light sensing devices, wherein the spillover value indicates an extent to which the modulated light stream is in focus at the sensor array, wherein the spillover value is computed by: constructing an image based on the sample set corresponding to the first light sensing element and also on the spatial patterns;summing pixels in the image outside the region corresponding to the first light sensing element. 42. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device;(b) the light modulation unit modulating an incident light stream with the sequence of spatial patterns to produce a modulated light stream;(c) a light sensing device of the CI device receiving the modulated light stream and acquiring a sequence of samples representing an intensity of the modulated light stream as a function of time, wherein the sequence of samples includes at least one sample for each of the spatial patterns;(d) constructing an image using the sequence of spatial patterns and the acquired samples;(e) computing a focus indicator value based on the image, wherein the focus indicator value indicates an extent to which the incident light stream is in focus at the light modulation unit; and(f) changing an angle of orientation of the light modulation unit based on data including the focus indicator value. 43. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device;(b) the light modulation unit modulating an incident light stream with the sequence of spatial patterns to produce a modulated light stream;(c) a light sensing device of the CI device receiving the modulated light stream and acquiring a sequence of samples representing an intensity of the modulated light stream as a function of time, wherein the sequence of samples includes at least one sample for each of the spatial patterns, wherein the light sensing device includes a plurality of light sensing elements, wherein each of the light sensing elements generates a respective electrical signal representing intensity of a respective spatial portion of the modulated light stream, wherein said acquiring the sequence of samples comprises adding the electrical signals to obtain a sum signal and sampling the sum signal;(d) constructing an image using the sequence of spatial patterns and the acquired samples;(e) computing a focus indicator value based on the image, wherein the focus indicator value indicates an extent to which the incident light stream is in focus at the light modulation unit. 44. A method for focusing a compressive imaging (CI) device, the method comprising: (a) supplying a sequence of spatial patterns to a light modulation unit of the CI device;(b) the light modulation unit modulating an incident light stream with the sequence of spatial patterns to produce a modulated light stream;(c) a light sensing device of the CI device receiving the modulated light stream and acquiring a sequence of samples representing an intensity of the modulated light stream as a function of time, wherein the sequence of samples includes at least one sample for each of the spatial patterns, wherein the light sensing device includes a plurality of light sensing elements, wherein each of the light sensing elements generates a respective electrical signal representing intensity of a respective spatial portion of the modulated light stream, wherein said acquiring the sequence of samples comprises sampling each of the electrical signals and adding the sampled versions of the electrical signals in the digital domain;(d) constructing an image using the sequence of spatial patterns and the acquired samples;(e) computing a focus indicator value based on the image, wherein the focus indicator value indicates an extent to which the incident light stream is in focus at the light modulation unit.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (7)
Kobayashi,Fumikazu, Focus control device and focus control method.
Saruwatari, Hiroshi; Fujii, Takashi; Mizoguchi, Yoshiyuki; Yamaguchi, Toshinobu; Murakami, Taro, Image pickup apparatus with moving image and still image focus control based on changing threshold value.
Baraniuk, Richard G.; Baron, Dror Z.; Duarte, Marco F.; Kelly, Kevin F.; Lane, Courtney C.; Laska, Jason N.; Takhar, Dharmpal; Wakin, Michael B., Method and apparatus for compressive imaging device.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.