High-speed event detection using a compressive-sensing hyperspectral-imaging architecture
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-007/18
H04N-005/232
출원번호
US-0664289
(2012-10-30)
등록번호
US-9325947
(2016-04-26)
발명자
/ 주소
Bridge, Robert F.
McMackin, Lenore
출원인 / 주소
InView Technology Corporation
대리인 / 주소
Meyertons Hood Kivlin Kowert & Goetzel, P.C.
인용정보
피인용 횟수 :
3인용 특허 :
18
초록▼
A compressive imaging system and method for quickly detecting spectrally and spatially localized events (such as explosions or gun discharges) occurring within the field of view. An incident light stream is modulated with a temporal sequence of spatial patterns. The wavelength components in the modu
A compressive imaging system and method for quickly detecting spectrally and spatially localized events (such as explosions or gun discharges) occurring within the field of view. An incident light stream is modulated with a temporal sequence of spatial patterns. The wavelength components in the modulated light stream are spatially separated, e.g., using a diffractive element. An array of photodetectors is used to convert subsets of the wavelength components into respective signals. An image representing the field of view may be reconstructed based on samples from some or all the signals. A selected subset of the signals are monitored to detect event occurrences, e.g., by detecting sudden changes in intensity. When the event is detected, sample data from the selected subset of signals may be analyzed to determine the event location within the field of view. The event location may be highlighted in an image being generated by the imaging system.
대표청구항▼
1. A system comprising: a spectral separation subsystem configured to receive a modulated light stream, wherein the modulated light stream is generated by modulating an incident light stream with a temporal sequence of spatial patterns, wherein the incident light stream carries images from an extern
1. A system comprising: a spectral separation subsystem configured to receive a modulated light stream, wherein the modulated light stream is generated by modulating an incident light stream with a temporal sequence of spatial patterns, wherein the incident light stream carries images from an external environment, wherein the spatial patterns belong to a set of measurement vectors that is incoherent with a second set of vectors in which the images are sparse, wherein the spectral separation subsystem is configured to separate the modulated light stream into a plurality of wavelength components;an array of light sensing elements, wherein the light sensing elements are configured to receive respective subsets of the wavelength components and to generate respective electrical signals, wherein each of the electrical signals represents intensity of the respective subset of the wavelength components as a function of time;a sampling subsystem configured to sample the electrical signals in order to obtain respective sample sequences;a detection unit configured to monitor a selected subset of the electrical signals to detect an event occurring within a field of view corresponding to the incident light stream, wherein said detecting the event includes determining when the selected subset of electrical signals satisfy a pre-determined signal condition;a processing unit configured to reconstruct a temporal sequence of images based on the sample sequences;a display device configured to the display the temporal sequence of images to a user;wherein the processing unit is configured to: in response to detecting said event, reconstruct a first image and a second image, wherein first image is reconstructed based on a first window of samples taken from the sample sequences corresponding to the selected subset, wherein the second image is reconstructed based on a second window of samples taken from the sample sequences corresponding to the selected subset, wherein the first window corresponds to a first time interval prior to the event, wherein the second window corresponds to a second time interval that at least partially includes the event;determine spatial localization information based on a difference between the first image and the second image, wherein the spatial localization information indicates where the event has occurred in the field of view; andinject a visual representation of the spatial localization information into at least a subset of the images of said temporal sequence of images, enabling the user to identify where the event has occurred in the field of view. 2. The system of claim 1, wherein the pre-determined signal condition is the condition that the electrical signals of the selected subset simultaneously exceed respective programmable thresholds. 3. The system of claim 1, wherein the detection unit includes a plurality of analog comparator circuits configured to compare respective electrical signals of the selected subset to respective programmable thresholds. 4. The system of claim 1, wherein the detection unit includes a plurality of digital comparator circuits, wherein each of the digital comparator circuits is configured to compare a respective one of the sample sequences of the selected subset to a respective programmable threshold. 5. The system of claim 1, wherein the detection unit includes a plurality of digital circuits, wherein each of the digital circuits is configured to compare a rate of change of a respective one of the sample sequences of the selected subset to a respective programmable threshold. 6. The system of claim 1, wherein the pre-determined signal condition is the logical AND of a first condition and a second condition, wherein the first condition is that the electrical signals of the selected subset simultaneously exceed respective programmable value thresholds, wherein the second condition is that rates of change of the respective electrical signals of the selected subset simultaneously exceed respective programmable rate thresholds. 7. The system of claim 1, wherein the pre-determined signal condition is the condition that the electrical signals of the selected subset have respective values that conform to a pre-determined spectral signature. 8. The system of claim 1, wherein said plurality of wavelength components comprises one or more continuous distributions of wavelength components spanning a wavelength range. 9. The system of claim 1, wherein the array of light sensing elements comprises a linear array. 10. The system of claim 1, wherein the processing unit is configured to: in response to detecting said event, perform a search process on one or more of the sample sequences belonging to the selected subset and during the occurrence of the event in order to identify a spatial subregion within the field of view that contains the event, wherein the search process includes: injecting search patterns into the temporal sequence of spatial patterns; andanalyzing the samples of the one or more sample sequences in response to the injection of the search patterns. 11. The system of claim 10, wherein the search process includes a hierarchical search based on a quadtree, wherein the quadtree corresponds to a recursive partitioning of the field of view into rectangular subsets. 12. The system of claim 10, wherein the processing unit is further configured to: inject a visual representation of the spatial subregion into at least a subset of the images of said temporal sequence of images. 13. The system of claim 1, wherein the selected subset of the electrical signals is programmable. 14. A method comprising: receiving a modulated light stream, wherein the modulated light stream is generated by modulating an incident light stream with a temporal sequence of spatial patterns;separating the modulated light stream into a plurality of wavelength components;converting subsets of the wavelength components into respective electrical signals, wherein each of the electrical signals represents intensity of the respective subset of the wavelength components as a function of time;sampling the electrical signals in order to obtain respective sample sequences;monitoring a selected subset of the electrical signals to detect an event occurring within a field of view corresponding to the incident light stream, wherein said detecting the event includes determining when the selected subset of electrical signals satisfy a pre-determined signal condition; andreconstructing a temporal sequence of images based on the sample sequences;displaying the sequence of temporal images via a display device;in response to detecting said event, reconstructing a first image and a second image, wherein first image is reconstructed based on a first window of samples taken from the sample sequences corresponding to the selected subset, wherein the second image is reconstructed based on a second window of samples taken from the sample sequences corresponding to the selected subset, wherein the first window corresponds to a first time interval prior to the event, wherein the second window corresponds to a second time interval that at least partially includes the event;determining spatial localization information based on a difference between the first image and the second image, wherein the spatial localization information indicates where the event has occurred in the field of view; andinjecting a visual representation of the spatial localization information into a subset of the images of said temporal sequence of images, enabling a user to identify where the event has occurred in the field of view. 15. The method of claim 14, wherein the pre-determined signal condition is the condition that the electrical signals of the selected subset simultaneously exceed respective programmable thresholds. 16. The method of claim 14, wherein the pre-determined signal condition is the condition that rates of change of the respective electrical signals of the selected subset exceed respective programmable thresholds. 17. The method of claim 14, wherein the pre-determined signal condition is the condition that the electrical signals of the selected subset have respective values that conform to a pre-determined spectral signature. 18. The method of claim 14, wherein said reconstructing the temporal sequence of images is initiated in response to said detection of the event. 19. The method of claim 14, further comprising: in response to detecting said event, performing a search process on one or more of the sample sequences belonging to the selected subset and during the occurrence of the event in order to identify a spatial subregion of the field of view that contains the event, wherein the search process includes: injecting search patterns into the temporal sequence of spatial patterns; andanalyzing the samples of the one or more sample sequences in response to the injection of the search patterns. 20. The method of claim 19, wherein the search process includes a hierarchical search based on a quadtree, wherein the quadtree corresponds to a recursive partitioning of the field of view into rectangular subsets. 21. The method of claim 19, further comprising: injecting a visual representation of the spatial subregion into at least a subset of the images of said temporal sequence of images. 22. The method of claim 14, wherein the selected subset of the electrical signals is programmable.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (18)
Nayar, Shree K.; Boult, Terrance E., Adaptive imaging using digital light processing.
Kelly, Kevin F.; Baraniuk, Richard G.; McMackin, Lenore; Bridge, Robert F.; Chatterjee, Sujoy; Hewitt, Donna E.; Weston, Tyler H., Low-pass filtering of compressive imaging measurements to infer light level variation.
Baraniuk, Richard G.; Baron, Dror Z.; Duarte, Marco F.; Kelly, Kevin F.; Lane, Courtney C.; Laska, Jason N.; Takhar, Dharmpal; Wakin, Michael B., Method and apparatus for compressive imaging device.
Layton Derek G. (Cambridge GB2) Smith Alan M. (Royston GB2) Fisher John H. (Royston GB2) Pettigrew Robert M. (Cambridgeshire GB2) Petty-Saphon Satham (Saffron Waldon GB2), Optical assay technique.
Kelchner, Bryan Lee; Jerkatis, Kenneth; Holmes, Richard Brooks; Mcnerney, Nikolaus; Donaldson, Jed, Aero-wave instrument for the measurement of the optical wave-front disturbances in the airflow around airborne systems.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.