[미국특허]
Method and system for categorizing detected motion events
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-021/431
H04N-021/4335
H04N-021/433
G06K-009/00
H04L-029/06
H04W-012/02
H04W-012/06
G06T-007/20
H04N-007/18
G06F-003/0481
G06F-003/0484
G11B-027/00
G11B-027/028
H04L-029/08
G06F-003/0482
G11B-027/031
G11B-027/30
G11B-027/34
G06K-009/32
H04N-005/14
H04N-021/239
G11B-027/10
H04N-005/93
H04N-009/87
H04W-004/00
H04W-012/08
H04N-021/422
출원번호
US-0510042
(2014-10-08)
등록번호
US-9420331
(2016-08-16)
발명자
/ 주소
Laska, Jason N.
Nelson, Greg R.
Duffy, Greg
출원인 / 주소
GOOGLE INC.
대리인 / 주소
Morgan, Lewis & Bockius LLP
인용정보
피인용 횟수 :
16인용 특허 :
56
초록▼
A computing system device with processor(s) and memory displays a video monitoring user interface on the display, the video monitoring user interface including a video feed from a camera located remotely from the client device in a first region of the video monitoring user interface and an event tim
A computing system device with processor(s) and memory displays a video monitoring user interface on the display, the video monitoring user interface including a video feed from a camera located remotely from the client device in a first region of the video monitoring user interface and an event timeline in a second region of the video monitoring user interface, and the event timeline includes indicators corresponding to motion events previously detected by the camera. The computing system obtains an indication of a detected motion event and associates the detected motion event with a respective category. The computing system displays an indicator for the detected motion event on the event timeline with a display characteristic corresponding to the respective category.
대표청구항▼
1. A method of categorizing and providing user feedback regarding a detected event, the method comprising: receiving a selection of a plurality of event zones within a field of view of a single video camera;displaying a video monitoring user interface on a display of a client device located remotely
1. A method of categorizing and providing user feedback regarding a detected event, the method comprising: receiving a selection of a plurality of event zones within a field of view of a single video camera;displaying a video monitoring user interface on a display of a client device located remotely from the video camera, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying a single event timeline, the single event timeline including a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region, the temporal position including a past time corresponding to the previously recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera, wherein the current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying the single event timeline on the second region of the video monitoring user interface according to a user-selected scale;displaying on the single event timeline a plurality of event indicators corresponding to one or more events previously detected from the live video feed during a period of time associated with the user-selected scale of the single event timeline, wherein: each of the one or more events is assigned to at least one of the plurality of event zones;each event is represented by a respective event indicator having a graphic display characteristic associated with a corresponding event zone to which the event is assigned; andthe graphic display characteristic is a visually unique color fill for each event zone; anddisplaying, for at least one of the plurality of event indicators, a corresponding static image from the live video feed, the static image being representative of the event associated with the event indicator; andin response to a detection of a new event in one of the event zones for the live video feed, displaying a new event indicator for the detected new event on the single event timeline, the new event indicator being displayed with the graphic display characteristic corresponding to the event zone in which the new motion event was detected. 2. The method of claim 1, further comprising: in accordance with a determination that one or more characteristics for the new event satisfy one or more criteria for the event zone, displaying a notification indicating that the detected new event has been detected in the event zone. 3. The method of claim 2, wherein the notification pops-up from the new event indicator for the detected new event. 4. The method of claim 2, wherein the notification is overlaid on the video in the first region of the video monitoring user interface. 5. The method of claim 2, wherein the notification is a banner notification displayed in a location corresponding to the top of the video monitoring user interface. 6. The method of claim 2, wherein the notification includes one or more affordances for providing feedback as to whether the detected new event is properly detected in the event zone. 7. The method of claim 1, wherein the event zone corresponds to a recognized event zone. 8. The method of claim 1, wherein the event zone corresponds to a previously created event. 9. The method of claim 8, further comprising: training a categorization model based on a training data set containing motion vectors corresponding to the event category, wherein common characteristics of the event category are extracted through the training to set forth the one or more categorization criteria and distinguish events associated with the event category from events associated with other event categories. 10. The method of claim 1, wherein the one or more events previously detected by the camera include a subset of events, further comprising: identifying a first event category associated with the subset of events; andretroactively modifying on the video monitoring user interface a display characteristic of a subset of event indicators corresponding to the subset of the events. 11. The method of claim 1, further comprising: detecting selection of a first event indicator of the one or more event indicators, the first event indicator corresponding to a first event of the one or more events; anddisplaying a dialog box for the first event corresponding to the first event indicator, wherein the dialog box includes at least one of a time the first event was detected and a preview of the first event. 12. The method of claim 1, further comprising: displaying one or more affordances in response to detection of a contact on the video monitoring user interface; andin accordance with an activation of the one or more affordances, enabling control of the camera including at least one of a zoom command and a microphone enabling/disabling command. 13. A computing system, comprising: one or more processors; andmemory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:receiving a selection of a plurality of event zones within a field of view of a single video camera;displaying a video monitoring user interface on a display of a client device located remotely from the video camera, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying a single event timeline, the single event timeline including a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region, the temporal position including a past time corresponding to the previously recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera, wherein the current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying the single event timeline on the second region of the video monitoring user interface according to a user-selected scale;displaying on the single event timeline a plurality of event indicators corresponding to one or more events previously detected from the live video feed during a period of time associated with the user-selected scale of the single event timeline, wherein: each of the one or more events is assigned to at least one of the plurality of event zones;each event is represented by a respective event indicator having a graphic display characteristic associated with a corresponding event zone to which the event is assigned; andthe graphic display characteristic is a visually unique color fill for each event zone; anddisplaying, for at least one of the plurality of event indicators, a corresponding static image from the live video feed, the static image being representative of the event associated with the event indicator; andin response to a detection of a new event in one of the event zones for the live video feed, displaying a new event indicator for the detected new event on the single event timeline, the new event indicator being displayed with the graphic display characteristic corresponding to the event zone in which the new motion event was detected. 14. The computing system of claim 13, wherein the one or more programs further comprise instructions for: displaying a notification indicating that the detected new event has been assigned to the respective event category. 15. The computing system of claim 14, wherein the notification pops-up from the indicator for the detected new event. 16. The computing system of claim 14, wherein the notification includes one or more affordances for providing feedback as to whether the detected new event is properly assigned to the respective event category. 17. The computing system of claim 13, wherein the event zone corresponds to a recognized event category. 18. The computing system of claim 13, wherein the event zone corresponds to a previously created zone of interest. 19. The computing system of claim 13, wherein the one or more events previously detected by the camera include a subset of events, wherein the one or more programs further comprise instructions for: identifying a first event category associated with the subset of events; andretroactively modifying on the video monitoring user interface a display characteristic of a subset of event indicators corresponding to the subset of the events. 20. The computing system of claim 13, wherein the one or more programs further comprise instructions for: detecting selection of a first event indicator of the one or more event indicators, the first event indicator corresponding to a first event of the one or more events; anddisplaying a dialog box for the first event corresponding to the first event indicator, wherein the dialog box includes at least one of a time the first event was detected and a preview of the first event. 21. The computing system of claim 13, wherein the one or more programs further comprise instructions for: displaying one or more affordances in response to detection of a contact on the video monitoring user interface; andin accordance with an activation of the one or more affordances, enabling control of the camera including at least one of a zoom command and a microphone enabling/disabling command. 22. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computing system with one or more processors, cause the computing system to perform operations comprising: receiving a selection of a plurality of event zones within a field of view of a single video camera;displaying a video monitoring user interface on a display of a client device located remotely from the video camera, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying a single event timeline, the single event timeline including a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region, the temporal position including a past time corresponding to the previously recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera, wherein the current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying the single event timeline on the second region of the video monitoring user interface according to a user-selected scale;displaying on the single event timeline a plurality of event indicators corresponding to one or more events previously detected from the live video feed during a period of time associated with the user-selected scale of the single event timeline, wherein: each of the one or more events is assigned to at least one of the plurality of event zones;each event is represented by a respective event indicator having a graphic display characteristic associated with a corresponding event zone to which the event is assigned; andthe graphic display characteristic is a visually unique color fill for each event zone; anddisplaying, for at least one of the plurality of event indicators, a corresponding static image from the live video feed, the static image being representative of the event associated with the event indicator; andin response to a detection of a new event in one of the event zones for the live video feed, displaying a new event indicator for the detected new event on the single event timeline, the new event indicator being displayed with the graphic display characteristic corresponding to the event zone in which the new motion event was detected. 23. The non-transitory computer readable storage medium of claim 22, wherein the instructions cause the computing system to perform operations further comprising: displaying a notification indicating that the detected new event has been detected in the event zone. 24. The non-transitory computer readable storage medium of claim 23, wherein the notification pops-up from the new event indicator for the detected new event. 25. The non-transitory computer readable storage medium of claim 23, wherein the notification includes one or more affordances for providing feedback as to whether the detected new event is properly detected in the event zone. 26. The non-transitory computer readable storage medium of claim 22, wherein the event zone corresponds to a recognized event zone. 27. The non-transitory computer readable storage medium of claim 22, wherein the event zone corresponds to a previously created event category. 28. The non-transitory computer readable storage medium of claim 22, wherein the one or more events previously detected by the camera include a subset of events, and wherein the instructions cause the computing system to perform operations further comprising: identifying a first event category associated with the subset of events; andretroactively modifying on the video monitoring user interface a display characteristic of a subset of event indicators corresponding to the subset of the events. 29. The non-transitory computer readable storage medium of claim 22, wherein the instructions cause the computing system to perform operations further comprising: detecting selection of a first event indicator of the one or more event indicators, the first event indicator corresponding to a first event of the one or more events; anddisplaying a dialog box for the first event corresponding to the first event indicator, wherein the dialog box includes at least one of a time the first event was detected and a preview of the first event. 30. The non-transitory computer readable storage medium of claim 22, wherein the instructions cause the computing system to perform operations further comprising: displaying one or more affordances in response to detection of a contact on the video monitoring user interface; andin accordance with an activation of the one or more affordances, enabling control of the camera including at least one of a zoom command and a microphone enabling/disabling command.
Kawashima, Yuji; Kikuchi, Yoshihiro; Fujisawa, Tatsuro; Suzuki, Shingo, Information processing apparatus with video encoding process control based on detected load.
Laska, Jason N.; Nelson, Gregory R.; Duffy, Greg; Mitsuji, Hiro; Hill, Cameron; Davidsson, Martin; Montalbo, Michael D.; Wan, Tung Yuen, Method and system for cluster-based video monitoring and event categorization.
Sharma, Rajeev; Mummareddy, Satish; Hershey, Jeff; Jung, Namsoon, Method and system for segmenting people in a physical space based on automatic behavior analysis.
Schonfeld,Dan; Hariharakrishnan,Karthik; Raffy,Philippe; Yassa,Fathy, Occlusion/disocclusion detection using K-means clustering near object boundary with comparison of average motion of clusters to object and background motions.
Borzycki, Andrew; Deva, Mallikharjuna Reddy; Gajendar, Uday Nandigam; Roychoudhry, Anil, Single sign-on access in an orchestration framework for connected devices.
Lane, Corey A.; Buck, Heidi L.; Li, Joshua S.; Bagnall, Bryan D.; Stastny, John C.; Hallenborg, Eric C., System for tracking maritime domain targets from full motion video.
Watts, Tim J.; Offerdahl, Alex; Atwood, Joe; Driscoll, Jim; Loar, Steve; Stabnow, Jeff, Systems, computer-implemented methods, and computer medium to determine premiums and indemnities for supplemental crop insurance.
Wilson Charles Park ; Pedersen ; Jr. Chris Harvey ; Auyeung Alex Kamlun ; MacCormack David Ross, Video data capture and formatting in intelligent video information management system.
Laska, Jason N.; Nelson, Greg R.; Duffy, Greg; Mitsuji, Hiro; Neal, Lawrence W.; Hill, Cameron, Method and system for generating a smart time-lapse video clip.
Laska, Jason N.; Nelson, Gregory R.; Duffy, Greg; Mitsuji, Hiro; Hill, Cameron; Davidsson, Martin; Montalbo, Michael D.; Wan, Tung Yuen, Method and system for non-causal zone search in video monitoring.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.