True space tracking of axisymmetric object flight using diameter measurement
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06T-007/20
출원번호
US-0921162
(2013-06-18)
등록번호
US-8948457
(2015-02-03)
발명자
/ 주소
Marty, Alan W.
Carter, John
출원인 / 주소
Pillar Vision, Inc.
대리인 / 주소
Kwan & Olynick LLP
인용정보
피인용 횟수 :
11인용 특허 :
61
초록▼
Methods and apparatus for determining a trajectory of a axisymmetric object in 3-D physical space using a digital camera which records 2-D image data are described. In particular, based upon i) a characteristic length of the axisymmetric object, ii) a physical position of the camera determined from
Methods and apparatus for determining a trajectory of a axisymmetric object in 3-D physical space using a digital camera which records 2-D image data are described. In particular, based upon i) a characteristic length of the axisymmetric object, ii) a physical position of the camera determined from sensors associated with the camera (e.g., accelerometers) and iii) captured 2-D digital images from the camera including a time at which each image is generated relative to one another, a position, a velocity vector and an acceleration vector can be determined in three dimensional physical space for axisymmetric object objects as a function of time. In one embodiment, the method and apparatus can be applied to determine the trajectories of objects in games which utilize axisymmetric object objects, such as basketball, baseball, bowling, golf, soccer, rugby or football.
대표청구항▼
1. A smart phone comprising: a housing;a wireless network interface;a camera lens and a touch screen display coupled to an exterior of the housing;a processor communicatively coupled to accelerometers and a digital image sensor disposed within an interior of the housing wherein the digital image sen
1. A smart phone comprising: a housing;a wireless network interface;a camera lens and a touch screen display coupled to an exterior of the housing;a processor communicatively coupled to accelerometers and a digital image sensor disposed within an interior of the housing wherein the digital image sensor receives light which passes through the camera lens;the processor configured to 1) receive a plurality of 2-D digital images from the digital image sensor, 2) output the plurality of 2-D digital images to the display, 3) select a portion of the plurality of 2-D digital images wherein the portion is selected based upon at least whether an axisymmetric object in free flight used in a play of a game is identifiable, 4) receive sensor data from the accelerometers which is used to determine an orientation of the camera lens in an earth reference frame; 5) based upon the orientation of the camera lens in the earth reference frame, transform first pixel data in each of the portion of the plurality of 2-D digital images from a first reference frame associated with a current orientation of the camera lens to second pixel data associated with a second reference frame in which the camera lens is resting on a horizontal plane perpendicular to an axis through a gravitational center of the earth and a line drawn through a center of lens perpendicular to a surface of lens is at a center of the pixel data; 6) determine a plurality of first pixel lengths across the axisymmetric object in multiple directions of the second pixel data in each of the portion of the plurality of 2-D digital images to account for motion blurring and light blooming effects; 7) based upon the plurality of first pixel lengths, determine a first characteristic pixel length of the axisymmetric object in each of the portion of the plurality of 2-D digital images; 8) based upon first characteristic pixel length, determine distances from the camera lens to the axisymmetric object in physical space in each of the portion of the plurality of 2-D digital images; 9) determine a center of the axisymmetric object in the second pixel data in each of the 2-D digital images; 10) determine a plurality of second pixel lengths which measure changes in the center of the axisymmetric object between each of the portion of the plurality of 2-D digital images; 11) based upon the plurality of second pixel lengths and the distances from the camera lens, determine a 3-D trajectory of the axisymmetric object as a function of time in physical space, 12) upload, via the wireless network interface, the 3-D trajectory to a remote server, 13) select one of the plurality of 2-D digital images, 14) render a path showing the 3-D trajectory of the axisymmetric object into the selected one of the plurality of 2-D digital images and 15) output to the display a new 2-D digital image including the path of the 3-D trajectory. 2. The smart phone of claim 1, wherein the axisymmetric object is a spherically shaped object. 3. The smart phone of claim 1, wherein the processor is further configured to determine a second characteristic pixel length of the axisymmetric object perpendicular to the first characteristic pixel length in each of the portion of the plurality of 2-D digital images; select one of the first characteristic pixel length or the second characteristic pixel length and based upon the selected one of the first characteristic pixel length or the second characteristic pixel length, determine the distance to the axisymmetric object. 4. The smart phone of claim 3, wherein the axisymmetric object is a football. 5. The smart phone of claim 3, wherein the axisymmetric object is a Frisbee. 6. The smart phone of claim 1, wherein the processor is further configured to identify one or more secondary objects associated with a play of the game captured in the plurality of the 2-D digital images. 7. The smart phone of claim 1, wherein the processor is further configured to output a first image of the plurality of 2-D images to the touch screen display, which includes a secondary object, and receive input from a touch screen display wherein the input from the touch screen display designates a portion of first image where the secondary object appears. 8. The smart phone of claim 7, wherein the processor is further configured to search in the designated portion of the first image to identify the secondary object. 9. The smart phone of claim 7, wherein, after the secondary object is identified, the processor is further configured to determine a second distance to secondary object from the camera lens. 10. The smart phone of claim 1, wherein the processor is further configure to receive a pixel resolution of the 2-D digital images. 11. The smart phone of claim 10, wherein the distances are determined based upon the received pixel resolution. 12. The smart phone of claim 10, wherein the processor is further configured to receive or retrieve a characteristic length of the axisymmetric object measured in units associated with 3-D physical space. 13. The smart phone of claim 1, wherein the axisymmetric object in one of the 2-D digital images is identified while partially obscured. 14. The smart phone of claim 1, wherein the axisymmetric object in one of the 2-D digital images is identified while being held in a person's hands. 15. The smart phone of claim 1, wherein the axisymmetric object in one of the 2-D digital images is identified while rolling along a surface or in contact with a surface. 16. The smart phone of claim 1, wherein the function of the time is based upon a time associated with each of the 2-D digital images. 17. The smart phone of claim 1, wherein the processor is further configured to receive a recording speed associated with the digital image sensor and to determine the function of the time based upon the recording speed. 18. The smart phone of claim 1, wherein the processor is further configured to determine a velocity vector and magnitude of the velocity vector as the function of time of the axisymmetric object along the 3-D trajectory. 19. The smart phone of claim 1, wherein processor is further configured to render one or more of a graphical representation of one or more of a playing field, playing field markings or a secondary object associated with the game in the new 2-D image. 20. The smart phone of claim 1, wherein only a first portion of a playing field, a first portion of a playing field markings or a first portion of a secondary object is captured in the one of the plurality of 2-D images and wherein the processor is further configured to render a second portion of the playing field, a second portion the playing field markings and/or a second portion of a secondary object in the new 2-D image such that the first portion and the second portion form a complete playing field, a complete playing field markings or a complete secondary object in the new 2-D image. 21. The smart phone of claim 1, wherein the processor is further configured to generate a simulation of the 3-D trajectory of the axisymmetric object using data determined from the 2-D digital images as initial conditions for the simulation. 22. The smart phone of claim 21, wherein the simulation is used to extrapolate the 3-D trajectory of the axisymmetric object beyond what is captured in the plurality of 2-D images. 23. The smart phone of claim 1, wherein information derived from the 3-D trajectory is used as input for a video game. 24. The smart phone of claim 1, wherein, based upon the 3-D trajectory, the processor is further configured to output, training recommendations for improving performance of a participant in the game played using the axisymmetric object.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (61)
Nashner Lewis M. (4011 Coho La. Lake Oswego OR 97034) Goldstein Daniel F. (1896 Palm Beach Lakes Blvd. West Palm Beach FL 33409), Apparatus and method for assessment and biofeedback training of body coordination skills critical and ball-strike power.
Rankin David B. (Lowell MA) Roberts ; Jr. Edgar P. (Winston-Salem NC) Kluttz James W. (Winston-Salem NC), Apparatus and method for tracking the flight of a golf ball.
Rankin David B. (Lowell MA) Roberts ; Jr. Edgar P. (Winston-Salem NC) Kluttz James W. (Winston-Salem NC), Apparatus and method for tracking the flight of a golf ball.
Lynch Francis deS. (Mattapoisett North Darmouth MA) Gobush William (North Darmouth MA) Sullivan Paul F. (Acushnet MA) Moore Randall W. (Acushnet MA) Haas Steven L. (Marion MA) Fonteneau Norman O. (Ac, Golf ball trajectory presentation system.
Witler James L. (403 Pine St. Minturn CO 81645) Spike Douglas L. (799 Deer Blvd. Eagle-Vail CO 81620) Talbot Douglas C. (625 Stone Creek Dr. Eagle-Vail CO 81620), Golfing apparatus.
Kluttz James W. (Winston-Salem NC) Roberts Edgar P. (Winston-Salem NC) Crockett Charles L. (Winston-Salem NC), Golfing apparatus and method for golf play simulation.
Gobush, William; Pelletier, Diane I.; Winfield, Douglas C.; Days, Charles; Aoyama, Steven; Hebert, Edmund A.; Silveira, James Alan, Launch monitor system with a calibration fixture and a method for use thereof.
Soignet Gerard C. (110 Isabelle Pl. Thibodaux LA 70301) Payne Wyndham C. (300 Ellen St. Ama LA 70031), Method and apparatus for indicating the optimal shot path of a basketball.
William Gobush ; Diane Pelletier ; Douglas C. Winfield ; Charles Days ; Steven Aoyama ; Edmund A. Hebert ; James Alan Silveira, Method and apparatus to determine golf ball trajectory and flight.
William Gobush ; Diane Pelletier ; Douglas C. Winfield ; Charles Days ; Steven Aoyama ; Edmund A. Hebert ; James Alan Silveira, Method and apparatus to determine golf ball trajectory and flight.
Vock Curtis A. ; Grealish Kevin J. ; Frey Robert D. ; Darcy Dennis ; Bianco Joseph, Method of and apparatus for golf driving range distancing using focal plane array.
Mouchet, Pierre C.; Bergel, Joan-Yves, Method, device and use of said method for biological elimination of metal elements present in an ionized state in water.
Gobush William (No. Dartmouth MA) Pelletier Diane (Fairhaven MA) Days Charles (So. Dartmouth MA), Monitoring systems to measure and display flight characteristics of moving sports object.
Mele Thomas C. (4804 Palisade Dr. Austin TX 78731) Mele Mary K. (4804 Palisade Dr. Austin TX 78731) Dyer Robert C. (4806 Palisade Dr. Austin TX 78731) Dyer Margaret A. (4806 Palisade Dr. Austin TX 78, Multifunctional basketball game monitoring unit.
Cavallaro Richard H. ; Gloudemans James R. ; Honey Stanley K. ; O'Brien Terence J. ; Phillips Alan C. ; Squadron William F. ; White Marvin S., System for determining the end of a path for a moving object.
Cavallaro Richard H. ; Gepner Jerry N. ; Gloudemans James R. ; Honey Stanley K. ; Squadron William F. ; White Marvin S., System for determining the position of an object.
Hughes, Walter, System, method and computer program product for measuring basketball player performance characteristics during instant replay of video and live sports games.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.