[미국특허]
Method and system for detecting and presenting a new event in a video feed
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-021/431
H04N-021/239
G08B-013/196
G06F-003/0488
G06F-003/0484
H04N-021/422
H04N-021/2743
H04N-021/2187
G06F-003/0485
H04N-021/462
H04W-012/04
H04N-021/4335
H04N-021/433
G06F-003/0482
G11B-027/031
G06K-009/32
G06K-009/00
H04L-029/06
H04W-012/02
H04W-012/06
G06T-007/20
H04N-007/18
G06F-003/0481
G11B-027/00
G11B-027/028
H04L-029/08
G11B-027/30
G11B-027/34
H04N-005/14
G11B-027/10
H04N-005/93
H04N-009/87
H04W-004/00
H04W-012/08
출원번호
US-0202503
(2016-07-05)
등록번호
US-9609380
(2017-03-28)
발명자
/ 주소
Laska, Jason N.
Nelson, Greg R.
Duffy, Greg
출원인 / 주소
GOOGLE INC.
대리인 / 주소
Morgan, Lewis & Bockius LLP
인용정보
피인용 횟수 :
4인용 특허 :
70
초록▼
The application is directed to a video monitoring user interface that includes a first region for displaying a live or recorded video feed from a video camera and a second region for displaying an event timeline. The event timeline includes equally spaced time indicators each indicating a specific t
The application is directed to a video monitoring user interface that includes a first region for displaying a live or recorded video feed from a video camera and a second region for displaying an event timeline. The event timeline includes equally spaced time indicators each indicating a specific time, and a moveable current video feed indicator indicating the temporal position of the video feed displayed in the first region. The temporal position includes a past time corresponding to the previously recorded video feed and a current time corresponding to the live video feed. The event timeline is displayed with event indicators corresponding to different types of events previously detected during a period of time associated with the event timeline. When a new event is detected, a new event indicator is displayed on the event timeline with the graphic display characteristic corresponding to the event type of the new event.
대표청구항▼
1. A method for categorizing and providing user feedback regarding a detected event, the method comprising: displaying a video monitoring user interface on a display of a client device located remotely from a video camera, the video monitoring user interface including a first region for displaying a
1. A method for categorizing and providing user feedback regarding a detected event, the method comprising: displaying a video monitoring user interface on a display of a client device located remotely from a video camera, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying an event timeline, wherein: the event timeline includes a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region;the temporal position includes a past time corresponding to the recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera; andthe current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying on the event timeline a plurality of event indicators corresponding to one or more different types of events previously detected from the live video feed during a period of time associated with the event timeline, wherein: each event is represented by an event indicator having a graphic display characteristic associated with the event type; andthe graphic display characteristic is selected from the group consisting of: a visually unique color, a visually unique pattern, and a visually unique icon, for each type of event; andin response to a detection of a new event, displaying a new event indicator for the detected new event on the event timeline, the new event indicator being displayed with the graphic display characteristic associated with the event type of the new event. 2. The method of claim 1, wherein each event of the one or more different types of events is assigned to a category of a plurality of categories for recognized event categories or created zones of interest. 3. The method of claim 2, wherein the video monitoring user interface further includes a third region for displaying the list of categories for recognized event categories or created zones of interest, and the list of categories includes the one or more different types of events previously detected from the live video feed during the period of time associated with the event timeline. 4. The method of claim 1, wherein the new event is detection of motion in a first zone of interest from a plurality of zones of interest, and the graphic display characteristic corresponds to the first zone of interest. 5. The method of claim 4, wherein the new event is detection of motion in a second zone of interest from the plurality of zones of interest that is different than the first zone of interest, and the graphic display characteristic corresponds to the second zone of interest and is different than the graphic display characteristic that corresponds to the first zone of interest. 6. The method of claim 1, further comprising: in response to a user selection of the event timeline at a past time temporal position corresponding to one of the plurality of event indicators that corresponds to a first event of the one or more different types of events, requesting a first video segment corresponding to the first event and displaying the first video segment in the first region of the video monitoring user interface. 7. The method of claim 1, wherein the video camera prioritizes uploading of video segments corresponding to the one or more different types of motion events ahead of video segments of the video stream that do not contain any event, and when a past time temporal position corresponding to a video segment that does not contain any event is selected, that video segment is not available for display in the first region of the video monitoring user interface. 8. The method of claim 1, wherein a first video segment corresponding to the one or more different types of events is configured to be displayed in the first region of the video monitoring user interface at a higher quality than a second video segment that does not corresponding to any of the one or more different types of events. 9. A computing system, comprising: one or more processors;a display; andmemory storing one or more instructions that, when executed by the one or more processors, cause the computing system to perform operations including:displaying a video monitoring user interface on the display, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from a video camera and a second region for displaying an event timeline, wherein: the event timeline includes a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region;the temporal position includes a past time corresponding to the recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera; andthe current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying on the event timeline a plurality of event indicators corresponding to one or more different types of events previously detected from the live video feed during a period of time associated with the event timeline, wherein: each event is represented by an event indicator having a graphic display characteristic associated with the event type; andthe graphic display characteristic is selected from the group consisting of: a visually unique color, a visually unique pattern, and a visually unique icon, for each type of event; andin response to a detection of a new event, displaying a new event indicator for the detected new event on the event timeline, the new event indicator being displayed with the graphic display characteristic associated with the event type of the new event. 10. The computing system of claim 9, wherein the operations further include: displaying, proximate to one of the plurality of event indicators, a thumbnail image from the corresponding event. 11. The computing system of claim 9, wherein the operations further include: in accordance with a determination that one or more characteristics of the new event satisfy one or more criteria, notifying a user of the computing system of the new event and the type of new event. 12. The computing system of claim 9, further comprising a speaker, wherein the operations further include: while displaying a video feed from the video camera, simultaneously outputting audio from the speaker that is captured by the video camera. 13. The computing system of claim 12, further comprising a microphone, wherein the operations further include: in response to receiving from a user of the computing system, via the video monitoring user interface, a microphone affordance, enabling an audio channel between the microphone of the computing system and a speaker of the video camera. 14. The computing system of claim 9, wherein each of the one or more different types of events is selected from a group consisting of: a motion event, an object based event, an audio event and a hazard alert. 15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by a computing system with one or more processors, cause the computing system to perform operations comprising: displaying a video monitoring user interface on a display of a client device located remotely from a video camera, the video monitoring user interface including a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying an event timeline, wherein: the event timeline includes a plurality of equally spaced time indicators each indicating a specific time and a current video feed indicator indicating the temporal position of the video feed displayed in the first region;the temporal position includes a past time corresponding to the recorded video feed from the video camera and a current time corresponding to the live video feed from the video camera; andthe current video feed indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video feed displayed in the first region;displaying on the event timeline a plurality of event indicators corresponding to one or more different types of events previously detected from the live video feed during a period of time associated with the event timeline, wherein: each event is represented by an event indicator having a graphic display characteristic associated with the event type; andthe graphic display characteristic is selected from the group consisting of: a visually unique color, a visually unique pattern, and a visually unique icon, for each type of event; andin response to a detection of a new event, displaying a new event indicator for the detected new event on the event timeline, the new event indicator being displayed with the graphic display characteristic associated with the event type of the new event. 16. The non-transitory computer readable storage medium of claim 15, wherein the operations further comprise: scrolling the displayed portion of the event timeline in response to receiving a swipe gesture. 17. The non-transitory computer readable storage medium of claim 15, wherein the operations further comprise: increasing the scale of the displayed event timeline in response to receiving a pinch-out gesture, anddecreasing the scale of the displayed event timeline in response to receiving a pinch-in gesture. 18. The non-transitory computer readable storage medium of claim 15, wherein the operations further comprise: receiving a user selection of a subset of the event timeline, the subset including a start time and an end time; andcausing a video clip to be generated, the video clip incorporating video that spans from the start time to the end time. 19. The non-transitory computer readable storage medium of claim 18, wherein a receiving a user selection of a subset of the event timeline includes displaying an adjustable overlay on the event timeline. 20. The non-transitory computer readable storage medium of claim 19, wherein the adjustable overlay may be moved via a dragging or pulling gesture.
Saft, Keith D.; Bernoulli, Carlo P.; Parry, Lee J.; Shephard, Megan D.; Poelker, Cole J., Graphic user interface for displaying content selections on a display panel.
Saft, Keith D.; Bernoulli, Carlo P.; Parry, Lee J.; Shephard, Megan D.; Poelker, Cole J., Graphical user interface for displaying content selections on a display panel.
Kawashima, Yuji; Kikuchi, Yoshihiro; Fujisawa, Tatsuro; Suzuki, Shingo, Information processing apparatus with video encoding process control based on detected load.
Laska, Jason N.; Nelson, Gregory R.; Duffy, Greg; Mitsuji, Hiro; Hill, Cameron; Davidsson, Martin; Montalbo, Michael D.; Wan, Tung Yuen, Method and system for cluster-based video monitoring and event categorization.
Sharma, Rajeev; Mummareddy, Satish; Hershey, Jeff; Jung, Namsoon, Method and system for segmenting people in a physical space based on automatic behavior analysis.
Schonfeld,Dan; Hariharakrishnan,Karthik; Raffy,Philippe; Yassa,Fathy, Occlusion/disocclusion detection using K-means clustering near object boundary with comparison of average motion of clusters to object and background motions.
Borzycki, Andrew; Deva, Mallikharjuna Reddy; Gajendar, Uday Nandigam; Roychoudhry, Anil, Single sign-on access in an orchestration framework for connected devices.
Lane, Corey A.; Buck, Heidi L.; Li, Joshua S.; Bagnall, Bryan D.; Stastny, John C.; Hallenborg, Eric C., System for tracking maritime domain targets from full motion video.
Laska, Jason N.; Hua, Wei; Chaudhry, Rizwan Ahmed; Varadharajan, Srivatsan; Heitz, III, George Alban, Systems and methods for categorizing motion event candidates.
Watts, Tim J.; Offerdahl, Alex; Atwood, Joe; Driscoll, Jim; Loar, Steve; Stabnow, Jeff, Systems, computer-implemented methods, and computer medium to determine premiums and indemnities for supplemental crop insurance.
Wilson Charles Park ; Pedersen ; Jr. Chris Harvey ; Auyeung Alex Kamlun ; MacCormack David Ross, Video data capture and formatting in intelligent video information management system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.