Systems and methods for correlating data from IP sensor networks for security, safety, and business productivity applications
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G08B-021/00
G08B-013/196
H04N-005/232
H04N-005/247
H04N-007/18
G06F-003/0481
H04L-012/24
H04L-029/08
G06F-003/06
출원번호
US-0091559
(2016-04-05)
등록번호
US-9619984
(2017-04-11)
발명자
/ 주소
Donovan, John J
Hussain, Daniar
출원인 / 주소
SecureNet Solutions Group LLC
인용정보
피인용 횟수 :
5인용 특허 :
110
초록▼
Monitoring systems and methods for use in security, safety, and business process applications utilizing a correlation engine are disclosed. Sensory data from one or more sensors are captured and analyzed to detect one or more events in the sensory data. The events are correlated by a correlation eng
Monitoring systems and methods for use in security, safety, and business process applications utilizing a correlation engine are disclosed. Sensory data from one or more sensors are captured and analyzed to detect one or more events in the sensory data. The events are correlated by a correlation engine, optionally by weighing the events based on attributes of the sensors that were used to detect the primitive events. The events are then monitored for an occurrence of one or more correlations of interest, or one or more critical events of interest. Finally, one or more actions are triggered based on a detection of one or more correlations of interest, one or more anomalous events, or one or more critical events of interest. Events may come from sensory devices, legacy systems, third-party systems, anonymous tips, and other data sources. The present invention may be used to increase business productivity by improving security, safety, and increasing profitability of business processes.
대표청구항▼
1. A monitoring system comprising a non-transitory, physical storage medium storing computer-readable program code, the program code executable by a hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising: receiving sens
1. A monitoring system comprising a non-transitory, physical storage medium storing computer-readable program code, the program code executable by a hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising: receiving sensory data about a physical environment from one or more sensors;receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;processing the sensory data from the one or more sensors to detect one or more primitive sensory events;normalizing the primitive sensory events into a standardized data format;storing the normalized sensory events in an event database for later retrieval;retrieving one or more stored sensory events from the event database;evaluating one or more historical correlations by automatically analyzing said stored sensory events, across at least one of time and space, for one or more historical correlations among the stored sensory events;monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; andsending one or more alerts based on at least one of said critical events and said network failure events. 2. The monitoring system of claim 1, wherein the historical correlations are calculated by applying a weighting of relative importance of the sensory data based on a quality of data produced by the sensors, wherein the primitive sensory events are weighted based at least on the quality of data produced by the sensors used to capture the sensory data. 3. The monitoring system of claim 1, wherein the critical events are determined from one or more safety procedures, and wherein the one or more alerts are sent when one or more of the safety procedures are violated. 4. The monitoring system of claim 1, wherein the one or more sensors are selected from the group consisting of a temperature probe, a pressure probe, an altitude meter, a speedometer, a revolutions per minute (RPM) meter, a blood pressure meter, a heart rate meter, a chlorine meter, a radon meter, a dust particle meter, a pollution meter, a CO2 meter, a bacteria meter, a water meter, an electrical meter, and combinations thereof. 5. The monitoring system of claim 1, further comprising program code to access one or more legacy systems, wherein the one or more legacy systems are selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, a light control system, and combinations thereof. 6. The monitoring system of claim 5, wherein the one or more legacy systems comprise at least a personnel system, and wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising: retrieving experience levels of personnel from the personnel system;correlating the experience levels of personnel with the primitive sensory events; andgenerating one or more alerts based on the correlation between the experience levels of personnel and the primitive sensory events. 7. The monitoring system of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising: performing one or more actions based on a correlation level exceeding a predetermined threshold. 8. The monitoring system of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising: generating one or more new rules based on primitive events correlated and alerts generated. 9. The monitoring system of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising: receiving tip data from one or more external sources;generating tip events based on the tip data;correlating one or more tip events with the primitive sensory events; andgenerating one or more alerts based on the correlation between the tip events and the primitive sensory events. 10. The monitoring system of claim 1, wherein the primitive sensory events are weighted based at least on one or more attribute data of the one or more sensors used to capture the sensory data. 11. The monitoring system of claim 10, wherein the attribute data comprises a quality of sensory data produced by the sensors. 12. The monitoring system of claim 10, wherein the attribute data comprises an age of the sensors used to capture the sensory data. 13. The monitoring system of claim 10, wherein the attribute data comprises a time since the sensors were last maintained. 14. The monitoring system of claim 10, wherein the attribute data comprises an integrity of the sensors used to capture the sensory data. 15. The monitoring system of claim 10, wherein the attribute data comprises a reliability of the sensors used to capture the sensory data. 16. The monitoring system of claim 10, wherein the attribute data comprises a reliability of power that is powering the sensors. 17. The monitoring system of claim 10, wherein the attribute data comprises a reliability of a transmission and a bandwidth of a communication link to the sensors. 18. The monitoring system of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising: providing a graphical user interface (GUI) for a human operator to receive the one or more alerts. 19. The monitoring system of claim 4, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute additional steps comprising: retrieving legacy system data from one or more legacy systems, wherein the one or more legacy systems are selected from the group consisting of a personnel system, an inventory system, a financial system, a currency system, and combinations thereof;correlating the legacy system data with the primitive sensory events; andgenerating one or more alerts based on the correlation between the legacy system data and the primitive sensory events. 20. The monitoring system of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute additional steps comprising: retrieving legacy system data from one or more legacy systems, wherein the one or more legacy systems are selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, a light control system, and combinations thereof;correlating the legacy system data with the stored sensory events; andgenerating one or more alerts based on the correlation between the legacy system data and the stored sensory events. 21. The system of claim 1, wherein the one or more primitive sensory events is at least a face detected. 22. The system of claim 21, wherein the face detected is correlated with other primitive events based on attribute data of a given sensor that detected the face. 23. The system of claim 21, wherein the face detected is correlated with another primitive event selected from the group consisting of a primitive sensory event and a primitive legacy event from a legacy system. 24. The system of claim 23, wherein the primitive legacy event is detected from a personnel system. 25. The system of claim 23, wherein the primitive legacy event is detected from an access control system. 26. The system of claim 1, wherein the one or more primitive sensory events is at least a presence of an intruder in a restricted area during a restricted time. 27. The system of claim 1, wherein the one or more primitive sensory events is at least a person or a vehicle entering a designated area during a designated time. 28. The system of claim 1, wherein the one or more primitive sensory events is at least a person or a vehicle leaving a designated area during a designated time. 29. The system of claim 1, wherein the one or more primitive sensory events is at least an object left in a restricted area during a designated time. 30. The system of claim 1, wherein the one or more primitive sensory events is at least an object taken from a designated area during a designated time. 31. The system of claim 1, wherein the one or more primitive sensory events is at least a vehicle driving a wrong way in a designated lane during a designated time. 32. The system of claim 1, wherein the one or more primitive sensory events is at least a person or a vehicle loitering in a designated area during a designated time. 33. The system of claim 1, wherein the one or more primitive sensory events is at least a speed of motion of an object. 34. The system of claim 1, wherein the one or more primitive sensory events is at least a size of an object. 35. The system of claim 1, wherein the one or more primitive sensory events is at least an area of motion of an object. 36. The system of claim 1, wherein the one or more primitive sensory events is at least an acceleration of an object. 37. The system of claim 1, wherein the one or more primitive sensory events is at least a type of a vehicle detected, wherein the type of the vehicle detected is selected from the group consisting of an SUV, a car, and a convertible. 38. The system of claim 1, wherein the one or more primitive sensory events is at least an audio event selected from the group consisting of a gunshot and a sound level above a given threshold. 39. The system of claim 1, wherein the one or more primitive sensory events is at least an audio event selected from the group consisting of a predetermined sound pattern and a predetermined keyword. 40. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: rebooting a given sensor upon failure of the given sensor. 41. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: sending the one or more alerts to a public address system. 42. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: sending a picture to a designated police. 43. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: sending a text message to a mass list. 44. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: turning lights on or off in a designated area. 45. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: turning a thermostat up or down. 46. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: turning a given sensor on or off. 47. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: following a person using a Pan-Zoom-Tilt (PTZ) camera. 48. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: following a person from camera to camera. 49. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: activating one or more electronic locks. 50. The system of claim 1, wherein the one or more sensors are selected from the group consisting of an altitude meter, a speedometer, a revolutions per minute (RPM) meter, and combinations thereof. 51. The system of claim 1, wherein the one or more sensors are selected from the group consisting of a blood pressure meter, a heart rate meter, and combinations thereof. 52. The system of claim 1, wherein the one or more sensors are selected from the group consisting of a chlorine meter, a radon meter, a dust particle meter, a CO2 meter, and combinations thereof. 53. The system of claim 1, wherein the one or more sensors are selected from the group consisting of a chlorine meter, a bacteria meter, a water meter, an electrical meter, and combinations thereof. 54. The system of claim 1, further comprising program code when executed by the hardware processor causing the hardware processor to execute steps comprising: detecting one or more compound events comprising one or more of the primitive sensory events. 55. The system of claim 54, wherein the one or more compound events comprise at least a number of people in a designated area. 56. The system of claim 54, wherein the one or more compound events comprise at least more people entering a designated area than leaving the designate area. 57. The system of claim 54, wherein the one or more compound events comprise at least a person being detected for less than a predetermined time in a designated area. 58. The system of claim 54, wherein the one or more compound events comprise at least a person being detected for more than a predetermined time in a designated area. 59. The system of claim 54, wherein the one or more compound events comprise at least a number of vehicles in a designated area. 60. The system of claim 54, wherein the one or more compound events comprise at least a percentage of a lane occupied. 61. The system of claim 54, wherein the one or more compound events comprise at least a presence of a person detected but no face detected. 62. The system of claim 54, wherein the one or more compound events comprise at least a vehicle loitering in a designated area followed by an intruder in a restricted area during a restricted time. 63. The system of claim 54, wherein the one or more compound events comprise at least multiple people loitering in different restricted locations during restricted times. 64. The system of claim 54, wherein the one or more compound events comprise at least a person entering a restricted area during a restricted time followed by a given sensor losing a given network connection based on its network status. 65. The system of claim 54, wherein the one or more compound events comprise at least a tailgating event, wherein the tailgating event comprises an unauthorized person following an authorized person into a designated area. 66. The system of claim 54, wherein the one or more compound events comprise at least two detected people becoming one detected person in the sensory data. 67. The system of claim 54, wherein the one or more compound events comprise at least a person entering a designated area but no person leaving the designated area. 68. The system of claim 54, wherein the one or more compound events comprise at least a count of a number of people entering a predetermined area during a predetermined time, and an identification of any times that the number of people entering the predetermined area during the predetermined time going up by more than a predetermined percentage. 69. The system of claim 54, wherein the one or more compound events comprise at least a security person not showing up during a predetermined period of time. 70. The system of claim 54, wherein the one or more compound events comprise at least that no given person is in a designated area when the given person's presence is required. 71. The system of claim 54, wherein the one or more compound events comprise at least that no object is left behind in a predetermined area during a predetermined time. 72. The system of claim 1, wherein the one or more primitive sensory events comprise at least two events from different sources selected from the group consisting of a primitive video event, a primitive audio event, a primitive non-video non-audio event, and a primitive legacy system event. 73. The system of claim 1, wherein the one or more primitive sensory events comprise at least three events from different sources selected from the group consisting of a primitive video event, a primitive audio event, a primitive non-video non-audio event, and a primitive legacy system event. 74. A monitoring method, comprising steps of: receiving sensory data about a physical environment from one or more sensors;receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;processing the sensory data from the one or more sensors to detect one or more primitive sensory events via a hardware processor;normalizing the primitive sensory events into a standardized data format;storing the normalized sensory events in an event database for later retrieval;retrieving one or more stored sensory events from the event database;evaluating one or more historical correlations by automatically analyzing said stored sensory events, across at least one of time and space, for one or more historical correlations among the stored sensory events;monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; andsending one or more alerts based on at least one of said critical events and said network failure events. 75. The method of claim 74, wherein the one or more sensors are selected from the group consisting of a temperature probe, a pressure probe, an altitude meter, a speedometer, a revolutions per minute (RPM) meter, a blood pressure meter, a heart rate meter, a chlorine meter, a radon meter, a dust particle meter, a pollution meter, a CO2 meter, a bacteria meter, a water meter, an electrical meter, and combinations thereof. 76. The method of claim 75, further comprising: retrieving legacy system data from one or more legacy systems, wherein the one or more legacy systems are selected from the group consisting of a personnel system, an inventory system, a financial system, a currency system, and combinations thereof;correlating the legacy system data with the primitive sensory events; andgenerating one or more alerts based on the correlation between the legacy system data and the primitive sensory events. 77. The method of claim 74, further comprising: retrieving legacy system data from one or more legacy systems, wherein the one or more legacy systems are selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, a light control system, and combinations thereof;correlating the legacy system data with the stored sensory events; andgenerating one or more alerts based on the correlation between the legacy system data and the stored sensory events.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (110)
Aviv David G. (New York NY), Abnormality detection and surveillance system.
Hershey, John Erik; Osborn, Brock Estel; Gardner, Donald Lee; Ruiz, Rafael Jose; Herron, William Lee, Aircraft gas turbine engine blade tip clearance control.
Dagtas, Serhan; Jasinschi, Radu S.; Dimitrova, Nevenka, Apparatus and method for program selection utilizing exclusive and inclusive metadata searches.
Farmer, Gilbert; Redden, Ronald D.; Shorter, Balena B.; Groeschen, James A.; Dede, Mehmet M.; Durstock, Daniel L., Corrugated cowl for combustor of a gas turbine engine and method for configuring same.
Christensen Steve W. ; Dasher John M. ; Martherus Robin E., File wrapper containing cataloging information for content searching across multiple platforms.
Donovan, John J.; Hussain, Daniar, Hierarchical data storage manager, anonymous tip processing engine, and a vehicle information processing engine for security and safety applications.
Angell, Robert Lee; Kraemer, James R., Identifying customer behavioral types from a continuous video stream for use in optimizing loss leader merchandizing.
Griffen Neil C. (Westerville OH) Stokes Richard S. (Westerville OH) Bioty Joseph F. (Westerville OH), Magneto-resistive tachometer sensor module with different resolution outputs for the same magnetic drum.
Wadia, Aspi Rustom; Christensen, David K.; Breeze-Stringfellow, Andrew; Chung, Kiyoung; Wiseman, Matthew William; Szucs, Peter Nicholas, Method and apparatus for an aerodynamic stability management system.
Bharadwaj, Sanjay; Venkateswaran, Narayanan; Yeung, Chung-hei Simon; Schirle, Steven Mark; Prasad, Johnalagadda Venkata Rama, Method and apparatus for continuous prediction, monitoring and control of compressor health via detection of precursors to rotating stall and surge.
Philip Lynn Andrew ; Chung-hei Simon Yeung ; John David Stampfli ; Joseph Anthony Cotroneo ; Steven Mark Schirle ; James Michael Hill, Method and apparatus for detecting and compensating for compressor surge in a gas turbine using remote monitoring and diagnostics.
Ohsie, David; DeSimone, Salvatore; Ferreira, Nelson; Yardeni, Eyal, Method and apparatus for system management using codebook correlation with symptom exclusion.
Lyons, Damian M.; Cohen-Solal, Eric; Gutta, Srinivas; Colmenarez, Jr., Antonio, Method and apparatus to select the best video frame to transmit to a remote station for CCTV based residential security monitoring.
Xu, Dan; Langan, David Allen; Wu, Xiaoye; Pack, Jed Douglas; Schmitz, Andrea Marie, Method and system for correlated noise suppression in dual energy imaging.
Herring,David; Carroll,John; O'Grady,Rehan; Coleman,Neil; Marks,Felix, Method and system for predicting causes of network service outages using time domain correlation.
Steinberg, Louis A.; Wetstone, Evan R.; Belousov, Arkadiy; Deuel, John, Method and system for reducing false alarms in network fault management systems.
Ozdemir, Hasan Timucin; Kibey, Sameer; Liu, Lipin; Lee, Kuo Chu; Mosali, Supraja; Joo, Namsoo; Li, Hongbing; Yu, Juan, Method and system for scoring surveillance system footage.
Wilson Dennis A. (McHenry IL) Williamsen Mark S. (Crystal Lake IL), Peripheral data acquisition, monitor, and adaptive control system via personal computer.
John Gamwell Almstead ; Maheshch Amritlal Morjaria ; Keith Andrew Longtin, Remote diagnostic system and method collecting sensor data according to two storage techniques.
Bonissone, Piero Patrone; Hershey, John Erik; Mitchell, Jr., Robert James; Subbu, Jr., Rajesh Venkat; Taware, Avinash Vinayak; Hu, Xiao, System and method for advanced condition monitoring of an asset system.
Hu, Xiao; Hershey, John Erik; Mitchell, Jr., Robert James; Subbu, Rajesh Venkat; Taware, Avinash Vinayak; Bonissone, Piero Patrone, System and method for advanced condition monitoring of an asset system.
Subbu, Rajesh Venkat; Hershey, John Erik; Hu, Xiao; Mitchell, Jr., Robert James; Taware, Avinash Vinayak; Bonissone, Piero Patrone, System and method for advanced condition monitoring of an asset system.
Siegel, Marc; Ho, Albert; Tossing, Christopher, System and method for generating quotations from a reference document on a touch sensitive display device.
Siegel, Marc; Ho, Albert; Tossing, Christopher, System and method for generating quotations from a reference document on a touch sensitive display device.
Ho, Albert; Siegel, Marc; Tossing, Christopher; Ierymenko, Adam; Hussain, Daniar, System and method used for configuration of an inspection compliance tool with machine readable tags and their associations to inspected components.
Jenkins Paul C. ; Deal David V. ; Cuthbertson Thomas G. ; Morton James W. ; Smith Andrew D. ; Hoy David R. ; Egeberg Gerald W., System for monitoring vehicle efficiency and vehicle and driver performance.
Leogrande,John A.; Jalbert,Peter L.; Wood,C. Bruce; Schryver,Matthew J., Systems and methods for monitoring thermal growth and controlling clearances, and maintaining health of turbo machinery applications.
Donovan, John J; Hussain, Daniar, Systems, methods, and apparatus for monitoring and alerting on large sensory data sets for improved safety, security, and business productivity.
Venetianer, Peter L.; Lipton, Alan J.; Chosak, Andrew J.; Frazier, Matthew F.; Haering, Niels; Myers, Gary W.; Yin, Weihong; Zhang, Zhong, Video surveillance system employing video primitives.
Venetianer, Peter L.; Lipton, Alan J.; Hu, Yongtong; Martone, Andrew J.; Yin, Weihong; Yu, Li; Zhang, Zhong, Video surveillance system employing video primitives.
Donovan,John J.; Hussain,Daniar, Video surveillance, storage, and alerting system having network management, hierarchical data storage, video tip processing, and vehicle plate analysis.
Stewart, James Edward; Yang, Seungho; Venters, Joe Delone; Hinz, Carsten, Display screen with graphical user interface for a timeline-video relationship presentation for alert events.
Donovan, John J; Hussain, Daniar, Systems and methods for correlating sensory events and legacy system events utilizing a correlation engine for security, safety, and business productivity.
Von Dehsen, Lauren; Kennedy, Zachery Webster; Boda, Ted; Ketterman, Jason; Boettcher, Jesse; Mizono, Michael; Brennessl, Tomas, Systems and methods for smart home automation using a multifunction status and entry point icon.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.