Drone detection and classification with compensation for background clutter sources
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G10L-025/51
G06F-017/30
G10L-025/39
G10L-025/21
H04R-029/00
G10L-025/18
G10L-019/00
출원번호
US-0360069
(2016-11-23)
등록번호
US-10032464
(2018-07-24)
발명자
/ 주소
Franklin, John
Hearing, Brian
출원인 / 주소
Droneshield, LLC
대리인 / 주소
K&L Gates LLP
인용정보
피인용 횟수 :
0인용 특허 :
12
초록▼
A system, method, and apparatus for detecting drones are disclosed. An example method includes receiving a digital sound sample and partitioning the digital sound sample into segments. The method also includes applying a frequency and power spectral density transformation to each of the segments to
A system, method, and apparatus for detecting drones are disclosed. An example method includes receiving a digital sound sample and partitioning the digital sound sample into segments. The method also includes applying a frequency and power spectral density transformation to each of the segments to produce respective sample vectors. For each of the sample vectors, the example method determines a combination of drone sound signatures and background sound signatures that most closely match the sample vector. The method further includes determining, for the sample vectors, if the drone sound signatures in relation to the background sound signatures that are included within the respective combinations are indicative of a drone. Conditioned on determining that the drone sound signatures are indicative of a drone, an alert message indicative of the drone is transmitted.
대표청구항▼
1. An apparatus configured to detect drones comprising: a microphone configured to receive a sound signal;a sound card configured to record a digital sound sample of the sound signal;a memory storing a plurality of drone sound signatures and a plurality of background sound signatures; anda processor
1. An apparatus configured to detect drones comprising: a microphone configured to receive a sound signal;a sound card configured to record a digital sound sample of the sound signal;a memory storing a plurality of drone sound signatures and a plurality of background sound signatures; anda processor configured to: apply a frequency transformation to the digital sound sample to create a sample time-frequency spectrum;determine a sample power spectral density of the sample time-frequency spectrum;perform single channel source separation of the sample power spectral density using a non-negative matrix factorization algorithm to determine which of the plurality of sound signatures in the memory are activated by determining a combination of the drone and background sound signatures stored in the memory that most closely match the sample power spectral density of the digital sound sample, andapplying a sparsity parameter to cause the non-negative matrix factorization algorithm to select a minimal combination of sound signatures needed to closely match the sample power spectral density;determine if at least one of the plurality of drone sound signatures are activated; andconditioned on the at least one of the plurality of drone sound signatures being activated, at least one of (i) transmit an alert indicative of a drone, and (ii) activate a beamformer to determine a location of a drone associated with the sound signal. 2. The apparatus of claim 1, wherein each of the drone and background sound signatures are stored as power spectral densities. 3. The apparatus of claim 1, wherein the drone and background sound signatures are stored within an m×p matrix W, where p is equal to a total number of drone and background sound signatures such that each column of the matrix W corresponds to a different drone or background sound signature and m is equal to a predetermined number of frequency bins, each entry within the matrix W specifying a power of the respective sound signature at the respective frequency bin. 4. The apparatus of claim 3, wherein the processor is configured to: partition the digital sound sample into n number of non-overlapping segments each having a predetermined duration;process each of the non-overlapping segments into a power spectral density vector; andcreate a sample m×n matrix M where n is equal to a total number of power spectral density vectors such that each column of the sample matrix M corresponds to a different power spectral density vector,wherein the sample matrix M has the same number m of predetermined frequency bins as the matrix W, andwherein each entry within the sample matrix M specifies a power of the respective power spectral density vector at the respective frequency bin. 5. The apparatus of claim 4, wherein the predetermined duration is between 0.05 seconds and 2 seconds. 6. The apparatus of claim 4, wherein the processor is configured to execute the non-negative matrix factorization algorithm to determine which of the plurality of sound signatures in the memory are activated by solving for an activation p×n matrix H, where the matrix W multiplied by the activation matrix H approximates the sample matrix M, wherein an i-th row and j-th column of the activation matrix H specifies a contribution of the drone or background sound signature at the i-th column of the matrix W for the power spectral density vector at the j-th column of the sample matrix M. 7. The apparatus of claim 6, wherein each entry of the activation matrix H includes a value greater than 0 that is indicative of how much of a respective drone or background sound signature matches a corresponding power spectral density vector across the predetermined number of frequency bins. 8. The apparatus of claim 4, wherein the non-negative matrix factorization algorithm is specified as: H←H⊗WT(M⊗Λβ-2)WTΛβ-1+μwhere T indicates a matrix transpose, μ is the sparsity parameter and is greater than 0, β is a cost function that measures a difference between a linear combination of the sound signatures and each of the power spectral density vectors, and Λ:=WH. 9. The apparatus of claim 8, wherein the matrices W and H are determined by: W,H=minW,HD(M❘WH). 10. A system configured to detect drones comprising: a drone detection device including: a microphone configured to receive a sound signal;a sound card configured to record a digital sound sample of the sound signal; anda frequency processor configured to: apply a frequency transformation to the digital sound sample to create a sample time-frequency spectrum,determine a sample power spectral density vector from the sample time-frequency spectrum, andtransmit the sample power spectral density vector for further analysis; anda server communicatively coupled to the drone detection device including: a memory storing a plurality of drone sound signatures and a plurality of background sound signatures; anda detection processor configured to determine which of the plurality of sound signatures in the memory are activated using a non-negative matrix factorization algorithm by determining a combination of the drone and background sound signatures stored in the memory that most closely match the sample power spectral density vector,determine if at least one of the plurality of drone sound signatures are activated, andconditioned on the at least one of the plurality of drone sound signatures being activated, at least one of (i) transmit an alert indicative of a drone, and (ii) activate a beamformer in proximity of the drone detection device to determine a location of a drone associated with the sound signal. 11. The apparatus of claim 10, wherein the drone detection device is deployed at a specific location and the server is located within at least one of a management server, a cloud computing environment, and a distributed computing environment remote from the specific location. 12. The apparatus of claim 10, wherein the detection processor is configured to: determine if at least one sample power spectral density vector previously received within a predetermined time period is associated with a detected drone;conditioned on the previously received sample power spectral density vectors not being associated with a detected drone, before determining which of the plurality of sound signatures in the memory are activated, update at least some of the background sound signatures based on the previously received sample power spectral density vectors; andconditioned on at least one of the previously received sample power spectral density vectors being associated with a detected drone, refrain from updating the background sound signatures. 13. The apparatus of claim 12, wherein the detection processor is configured to use the non-negative matrix factorization algorithm to update the at least some of the background sound signatures by iteratively changing (i) the at least some of the background sound signatures and (ii) activations of the background sound signatures such the combination of (i) and (ii) closely approximates the previously received sample power spectral density vectors. 14. The apparatus of claim 10, wherein the detection processor is configured to: determine an error associated with the combination of the drone and background sound signatures that most closely match the sample power spectral density vector; andconditioned upon the error exceeding a threshold, determine that a drone is not detected. 15. The apparatus of claim 10, wherein the detection processor is configured to: determine a ratio between activated drone sound signatures and activated background sound signatures; andconditioned upon the ratio not exceeding a threshold, determine that a drone is not detected. 16. A method for detecting drones comprising: receiving, via an interface, a digital sound sample;partitioning, via a processor, the digital sound sample into segments;applying, via the processor, a frequency and power spectral density transformation to each of the segments to produce respective sample vectors;for each of the sample vectors, determining, via the processor, a combination of drone sound signatures and background sound signatures stored in a memory that most closely match the sample vector;applying for each of the sample vectors, via the processor, a sparsity constraint to the combination of drone sound signatures and background sound signatures to select a minimal combination of sound signatures needed to closely match the respective sample vector;determining, via the processor, for the sample vectors, if the drone sound signatures in relation to the background sound signatures that are included within the respective minimal combinations are indicative of a drone; andconditioned on determining the drone sound signatures are indicative of a drone, transmitting an alert message indicative of the drone. 17. The method of claim 16, further comprising: determining, via the processor, frequency bins of the drone sound signatures included within the minimal combination that are indicative of the drone; andtransmitting, via the processor, an indication of at least some of the determined frequency bins to a beamformer directional finder to determine a location of the drone. 18. The method of claim 16, further comprising: determining, via the processor, a classification of the drone based on metadata associated with the drone sound signatures that are included within the minimal combination; andtransmitting, via the processor, the classification in conjunction with the alert. 19. The method of claim 16, wherein the processor is configured to determine the combination or the minimal combination by performing a sum-of-squares or least squares regression analysis to determine which of the drone sound signatures and the background sound signatures have minimal power differences between certain groups of frequency bins. 20. The method of claim 16, wherein the minimal combination includes only drone sound signatures and no background sound signatures or only background sound signatures and no drone sound signatures, wherein the alert is not transmitted if the combination only includes background sound signatures.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (12)
Lee, Jonathan S.; Nielsen, Richard O.; Davis, Henry Hooper; Dunholter, Paul H., Acoustic airport surveillance system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.