Motion event recognition and video synchronization system and method
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
A63F-009/24
G06K-009/00
G11B-027/17
G11B-031/00
G11B-027/022
G06T-007/20
H04N-007/18
출원번호
US-0257959
(2014-04-21)
등록번호
US-9076041
(2015-07-07)
발명자
/ 주소
Bentley, Michael
Kaps, Ryan
Bose, Bhaskar
Alam, Sheehan
Gillen, Michael
Abdel-Rahman, Mazen
출원인 / 주소
BLAST MOTION INC.
대리인 / 주소
ARC IP Law, PC
인용정보
피인용 횟수 :
7인용 특허 :
100
초록▼
Enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. May use integrated camera or external cameras with r
Enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. May use integrated camera or external cameras with respect to mobile device to automatically generate generally smaller event videos of the event on the mobile device or server. Also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users. Provides low memory and power utilization and greatly reduces storage for video data that corresponds to events such as a shot, move or swing of a player, a concussion of a player, or other medical related events or events, such as the first steps of a child, or falling events.
대표청구항▼
1. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to cap
1. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to capture any combination of values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;a radio;a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to collect data that comprises sensor values from said sensor;store said data in said memory;analyze said data and recognize an event within said data to determine event data;transmit said event data associated with said event via said radio;a mobile device comprising a computer;a wireless communication interface configured to communicate with said radio to obtain said event data associated with said event;wherein said computer is coupled with wireless communication interface, wherein said computer is configured to receive said event data from said wireless communication interface;analyze said event data to form motion analysis data;store said event data, or said motion analysis data, or both said event data and said motion analysis data;obtain an event start time and an event stop time from said event data;request image data from a camera comprising a video captured at least during a timespan from said event start time to said event stop time;display an event video on a display comprising both of said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time and said video captured during said timespan from said event start time to said event stop time; and,wherein said computer is further configured to discard at least a portion of said video outside of said event start time to said event stop time and store said event video without said portion of said video outside of said event start time to said event stop time to a server computer external to said computer. 2. The system of claim 1 wherein said computer is further configured to determine a clock difference between said motion capture element and said mobile device and synchronize said motion analysis data with said video. 3. The system of claim 1 wherein said system further comprises a server computer remote to said mobile device and wherein said server computer is further configured to discard at least a portion of said video outside of said event start time to said event stop and return said video captured during said timespan from said event start time to said event stop time to said computer in said mobile device. 4. The system of claim 1 wherein said computer is further configured to save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time. 5. The system of claim 1 wherein said system further comprises a server computer remote to said mobile device and wherein said server computer is configured to save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time and return said video captured during said timespan from said event start time to said event stop time to said computer in said mobile device. 6. The system of claim 1 wherein said computer is further configured while a communication link is open between said at least one motion capture sensor and said mobile device to discard at least a portion of said video outside of said event start time to said event stop and save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time. 7. The system of claim 1 wherein said computer is further configured while a communication link is not open between said at least one motion capture sensor and said mobile device to save video and after said event is received after said communication link is open, then discard at least a portion of said video outside of said event start time to said event stop and save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time. 8. The system of claim 1 wherein said video is obtained from a camera coupled with said mobile device. 9. The system of claim 1 wherein said video is obtained from a camera remote from said mobile device. 10. The system of claim 1 wherein said video is obtained from a server remote to said mobile device. 11. The system of claim 1 wherein said at least one motion capture sensor is configured to be worn near the user's head and wherein said recognize said event within said data comprises calculation of a location of impact on the user's head. 12. The system of claim 11 wherein said at least one motion capture sensor is configured to couple with a hat or cap or mouthpiece. 13. The system of claim 11 wherein said at least one motion capture sensor is configured to couple with a helmet and wherein said recognize said event within said data comprises calculation of the location of impact on the user's head based on the physical geometry of the helmet. 14. The system of claim 1 further comprising an isolator configured to surround said at least one motion capture element to approximate physical acceleration dampening of cerebrospinal fluid around said user's brain to minimize translation of linear acceleration and rotational acceleration of said event data to obtain an observed linear acceleration and an observed rotational acceleration of the user's brain. 15. The system of claim 1 wherein said computer is configured to synchronize said video and said event data, or said motion analysis data via image analysis to more accurately determine a start event frame or stop event frame in said video or both, that is most closely associated with said event start time or said event stop time or both. 16. The system of claim 1 wherein said server is further configured to synchronize said video and said event data, or said motion analysis data via image analysis to more accurately determine a start event frame or stop event frame in said video or both, that is most closely associated with said event start time or said event stop time or both. 17. The system of claim 1 wherein said computer is further configure to access previously stored event data or motion analysis data associated with said user or piece of equipment; wherein said display information comprises a presentation of said event data associated with said at least one user on a display based on said event data or motion analysis data associated with said user or piece of equipment and said previously stored event data or motion analysis data associated with said user or piece of equipment orsaid previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment. 18. The system of claim 1 wherein said microcontroller in said at least one motion capture element is configured to transmit said event to at least one other motion capture sensor or at least one other mobile device or any combination thereof, and wherein said at least one other motion capture sensor or said at least one other mobile device or any combination thereof is configured to save data associated with said event. 19. The system of claim 1 further comprising: an identifier coupled with said at least one motion capture sensor or said user or said piece of equipment;said computer further configured to receive said identifier; andassociate said identifier with said event data and motion analysis data. 20. The system of claim 1 wherein said at least one motion capture element further comprises a light emitting element configured to output light if said event occurs. 21. The system of claim 1 wherein said at least one motion capture element further comprises an audio output element configured to output sound if said event occurs or if said at least one motion capture sensor is out of range of said computer or wherein said computer is configured to display and alert if said at least one motion capture sensor is out of range of said computer, or any combination thereof. 22. The system of claim 1 wherein said at least one motion capture element further comprises a location determination element configured to determine a location that is coupled with said microcontroller and wherein said microcontroller is configured to transmit said location to said computer or wherein said microcontroller is configured to transmit said location to said server and wherein said computer or server is configured to form said event video from portions of said video based on said location and said event start time and said event stop time. 23. The system of claim 1 wherein said microcontroller or said computer is configured to determine a location of said event or wherein said microcontroller and said computer are configured to determine the location of said event and correlate the location. 24. The system of claim 1 wherein said computer is further configured to request at least one image or video that contains said event from at least one camera proximal to said event or from said server. 25. The system of claim 1 wherein said computer is further configured to broadcast a request for camera locations proximal to said event or oriented to view said event. 26. The system of claim 1 wherein said computer is further configured to display a list of one or more times at which said event has occurred or wherein one or more events has occurred. 27. The system of claim 1 wherein at least one motion capture sensor is physically coupled with said mobile device. 28. The system of claim 1 wherein the microcontroller is coupled with a temperature sensor and wherein said microcontroller is configured to transmit a temperature obtained from the temperature sensor as a temperature event. 29. The system of claim 1 wherein said event comprises motion associated with said at least one motion capture sensor coupled with any combination of said user, or said piece of equipment or said mobile device ormotion indicative of standing, walking, falling, heat stroke, a seizure, violent shaking, a concussion, a collision, abnormal gait, abnormal or non-existent breathing orany combination thereof. 30. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to capture any combination of values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;a radio;a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to collect data that comprises sensor values from said sensor;store said data in said memory;analyze said data and recognize an event within said data to determine event data;transmit said event data associated with said event via said radio;a mobile device comprising a computer;a wireless communication interface configured to communicate with said radio to obtain said event data associated with said event;wherein said computer is coupled with wireless communication interface, wherein said computer is configured to receive said event data from said wireless communication interface;analyze said event data to form motion analysis data;store said event data, or said motion analysis data, or both said event data and said motion analysis data;obtain an event start time and an event stop time from said event;request image data from camera comprising a video captured at least during a timespan from said event start time to said event stop time;display an event video on a display comprising both of said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time andsaid video captured during said timespan from said event start time to said event stop time;a server computer remote to said mobile device, wherein said server computer is configured to discard at least a portion of said video outside of said event start time to said event stop, andreturn said video captured during said timespan from said event start time to said event stop time to said computer in said mobile device. 31. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to capture any combination of values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;a radio;a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to collect data that comprises sensor values from said sensor;store said data in said memory;analyze said data and recognize an event within said data to determine event data;transmit said event data associated with said event via said radio;a mobile device comprising a computer;a wireless communication interface configured to communicate with said radio to obtain said event data associated with said event;wherein said computer is coupled with wireless communication interface, wherein said computer is configured to receive said event data from said wireless communication interface;analyze said event data to form motion analysis data;store said event data, or said motion analysis data, or both said event data and said motion analysis data;obtain an event start time and an event stop time from said event;request image data from camera comprising a video captured at least during a timespan from said event start time to said event stop time;display an event video on a display comprising both of said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time andsaid video captured during said timespan from said event start time to said event stop time; andwhile a communication link is open between said at least one motion capture sensor and said mobile device, to discard at least a portion of said video outside of said event start time to said event stop and save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time. 32. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to capture any combination of values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;a radio;a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to collect data that comprises sensor values from said sensor;store said data in said memory;analyze said data and recognize an event within said data to determine event data;transmit said event data associated with said event via said radio;a mobile device comprising a computer;a wireless communication interface configured to communicate with said radio to obtain said event data associated with said event;wherein said computer is coupled with wireless communication interface, wherein said computer is configured to receive said event data from said wireless communication interface;analyze said event data to form motion analysis data;store said event data, or said motion analysis data, or both said event data and said motion analysis data;obtain an event start time and an event stop time from said event;request image data from camera comprising a video captured at least during a timespan from said event start time to said event stop time;display an event video on a display comprising both of said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time andsaid video captured during said timespan from said event start time to said event stop time; andwhile a communication link is not open between said at least one motion capture sensor and said mobile device, to save video and after said event is received after said communication link is open, then discard at least a portion of said video outside of said event start time to said event stop and save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time. 33. A motion event recognition and video synchronization system comprising: at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises a memory;a sensor configured to capture any combination of values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;a radio;a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to collect data that comprises sensor values from said sensor;store said data in said memory;analyze said data and recognize an event within said data to determine event data;transmit said event data associated with said event via said radio;a mobile device comprising a computer;a wireless communication interface configured to communicate with said radio to obtain said event data associated with said event;wherein said computer is coupled with wireless communication interface, wherein said computer is configured to receive said event data from said wireless communication interface;analyze said event data to form motion analysis data;store said event data, or said motion analysis data, or both said event data and said motion analysis data;obtain an event start time and an event stop time from said event;request image data from camera comprising a video captured at least during a timespan from said event start time to said event stop time;display an event video on a display comprising both of said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time andsaid video captured during said timespan from said event start time to said event stop time;wherein said at least one motion capture element further comprises a location determination element configured to determine a location that is coupled with said microcontroller; and wherein said microcontroller is configured to transmit said location to said computer, orwherein said system further comprises a server and wherein said microcontroller is further configured to transmit said location to said server; andwherein said computer or server is further configured to form said event video from portions of said video based on said location and said event start time and said event stop time.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (100)
Kramer James F. (Menlo Park CA), Accurate, rapid, reliable position sensing using multiple sensing technologies.
Molyneux, James; Weast, Aaron B.; Burroughs, Brandon S.; Berggren, Scott R.; Lindsay, Clayton J.; Rice, Jordan M.; Buxton, Bert B.; Lowe, Edward S., Athletic performance monitoring systems and methods in a team sports environment.
Stites, John T.; Hadden, Jeffrey Alan; Snyder, Jeremy; Glenn, Bradley Charles; Simpson, Daniel John; Roberts, Daniel Alan; Thomas, James S.; Thornton, Douglas Anthony, Golf clubs and golf club heads having digital lie and/or other angle measuring equipment.
Huston Charles D. (4607 Trail West Dr. Austin TX 78735) Cornish Darryl J. (8017 Davis Mountain Pass Austin TX 78726), Golf distance measuring system and method.
Carbary Lawrence Donald,KRX ; Nowak Chris Edward ; O'Brien William Robert ; Waters Leslie Joan, Insulating glass units containing intermediate plastic film and method of manufacture.
Crook, Dale W.; Fullerton, Larry W.; Kelly, Donald A., Method and apparatus for managing golf related information obtained in part by using impulse radio technology.
Kim Charles Hongchul (3432 Stage Coach Dr. Lafayette CA 94549), Method of training physical skills using a digital motion analyzer and an accelerometer.
Meadows,James W.; Root,Richard L.; Nash, II,Dallas L.; Edmonson,Richard C., Personal golfing assistant and method and system for graphically displaying golf related information and for collection, processing and distribution of golf related data.
Vock, Curtis A.; Darcy, Dennis; Flentov, Peter, Shoes and garments employing one or more of accelerometers, wireless transmitters, processors altimeters, to determine information such as speed to persons wearing the shoes or garments.
Vock, Curtis A.; Darcy, Dennis; Flentov, Peter, Shoes and garments employing one or more of accelerometers, wireless transmitters, processors, altimeters, to determine information such as speed to persons wearing the shoes or garments.
Vock,Curtis A.; Darcy,Dennis; Flentov,Peter, Shoes and garments employing one or more of accelerometers, wireless transmitters, processors, altimeters, to determine information such as speed to persons wearing the shoes or garments.
Matcovich Robert R. (King of Prussia PA) Matcovich Thomas J. (Maple Glen PA) Matcovich John J. (Woodside NY) Paist Kenneth W. (Philadelphia PA), Sports implement swing analyzer.
Stites, John T.; Tavares, Gary; Madore, Carl; Kelly, Michael; Sander, Raymond J.; Hadden, Jeffrey A.; Held, Jeffrey R.; Meanle, Garrick L.; Kramer, Gregory S.; Bouton, Chad E.; Dodson, Clifford N.; Hoffman, Patrick K., System for determining performance characteristics of a golf swing.
Kunzle, Adrian E.; Garcia, V. Maximillian, Systems and methods wherein at least one set of possible input parameters to a physics simulation will produce a successful game result.
Sabatino Joseph (1821 Saxon La. Maple Glen PA 19002) Gillen Adelbert M. (1 Cornwell Dr. Solebury PA 18938) Makki Amir (2500 Belmont Ave. ; Apartment A409 Philadelphia PA 19131 4), Velocity monitoring system for golf clubs.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.