Systems, devices, and methods for tracking moving targets
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06T-007/20
G06T-007/00
출원번호
US-0831115
(2013-03-14)
등록번호
US-9305365
(2016-04-05)
발명자
/ 주소
Lovberg, John Arthur
Pan, Xiaojiang Jason
출원인 / 주소
KINETICOR, INC.
대리인 / 주소
Knobbe Martens Olson & Bear LLP
인용정보
피인용 횟수 :
10인용 특허 :
269
초록▼
A system for tracking a moving target having up to six degrees of freedom and rapidly determining positions of the target, said system includes an easy to locate precision optical target fixed to the target. This system includes at least two cameras positioned so as to view the optical camera from d
A system for tracking a moving target having up to six degrees of freedom and rapidly determining positions of the target, said system includes an easy to locate precision optical target fixed to the target. This system includes at least two cameras positioned so as to view the optical camera from different directions with each of the at least two cameras being adapted to record two dimensional images of the precision optical target defining precise target point. A computer processor is programmed to determine the target position of x, y and z and pitch, roll and yaw. In an embodiment, the system can be configured to utilize an iteration procedure whereby an approximate first-order solution is proposed and tested against the identified precise target points to determine residual errors which can be divided by the local derivatives with respect to each component of rotation and translation, to determine an iterative correction.
대표청구항▼
1. A system for tracking a moving target having up to six degrees of freedom and rapidly determining positions of the moving target, said system comprising: A) A precision optical target fixed to the moving target,B) at least two cameras positioned so as to view the optical target from different dir
1. A system for tracking a moving target having up to six degrees of freedom and rapidly determining positions of the moving target, said system comprising: A) A precision optical target fixed to the moving target,B) at least two cameras positioned so as to view the optical target from different directions with each of the at least two cameras being adapted to record two dimensional images of the precision optical target defining a precise target point,C) a computer processor programmed to determine a target position in Cartesian coordinates of x, y, and z and pitch, roll and yaw utilizing an algorithm adapted to: 1) identify the precise target point on the precision optical target and the x, y and z displacement of the precise target point based on optical images collected by the at least two cameras,2) utilize an iteration procedure whereby an approximate first-order solution is proposed and tested against the identified precise target points to determine residual errors which are then divided by the local derivatives with respect to each component of rotation and translation, to determine an iterative correction,3) repeat step 2 until residual error becomes smaller than desired accuracy, and4) utilize the results of steps 1), 2) and 3) to determine the position of the target at rates of at least 100 times per second. 2. The system as in claim 1 wherein the moving target is a human head. 3. The system as in claim 1 and configured to interface as a component of an MRI device. 4. The system as in claim 1 wherein the iteration procedure is a variant of the Newton-Raphson method. 5. The system as in claim 2 wherein movements are measured relative to a pivot point in the patient's neck. 6. The system as in claim 2 wherein measurements are updated at a rate of at least 100 solutions per second with a latency of less than 10 milliseconds. 7. The system as in claim 2 wherein measurements are updated at a rate of at least 200 solutions per second with a latency of less than 10 milliseconds. 8. The system as in claim 3 wherein the system is adapted to report to MRI systems the exact position of the head with accuracies better than 0.1 mm in distances and 0.1 degree in angles. 9. The system as in claim 1 wherein the precision optical target comprises at least three concentric sub-targets. 10. The system as in claim 2 wherein the precision optical target is fixed to at least one of the patient's upper teeth. 11. The system as in claim 9 wherein the three concentric sub-targets are each concentric ellipses. 12. The system as in claim 9 wherein the computer processor is programmed to calculate centroids of each sub-target by dividing (a) a sum of a product of pixel intensity and pixel position by (b) a sum of pixel intensity in a sub-pixel array. 13. The system as in claim 11 wherein the pixel array is about 48×48 pixels. 14. A method for tracking a moving target having up to six degrees of freedom and rapidly determining positions of the target comprising the steps of: A) attaching a precision optical target fixed to the moving target,B) positioning at least two cameras positioned so as to view the optical target from different directions with each of the at least two cameras being adapted to record two dimensional images of the precision optical target defining a precise target point,C) programming a computer processor to determine the target position in Cartesian coordinates of x, y and z and pitch, roll and yaw utilizing an algorithm adapted to 1) identify a precise target point on the precision optical target and the x, y and z displacement of the precise target point based on optical images collected by the at least two cameras,2) utilize an iteration procedure whereby an approximate first-order solution is proposed and tested against the identified precise target points to determine residual errors which are then divided by the local derivatives with respect to each component of rotation and translation, to determine an iterative correction,3) repeat step 2 until residual error becomes smaller than desired accuracy, and4) utilize the results of steps 1), 2) and 3) to determine the position of the target at rates of at least 100 times per second. 15. The method as in claim 14 wherein the target is a human head. 16. The method as in claim 15 wherein tracking results are utilized as an input to an MRI device so as to adjust its magnetic fields to compensate for movements of the human head. 17. The method as in claim 14 wherein the iteration procedure is a variant of the Newton-Raphson method. 18. The method as in claim 15 wherein movements are measured relative to a pivot point in the patient's neck. 19. The method as in claim 14 wherein measurements are up-dated at a rate of at least 100 solutions per second with a latency of less than 10 milliseconds. 20. The method as in claim 14 wherein measurements are up-dated at a rate of at least 200 solutions per second with a latency of less than 10 milliseconds. 21. The method as in claim 16 wherein the system is adapted to report to MRI systems the exact position of the head with accuracies better than 0.1 mm in distances and 0.1 degree in angles. 22. The method as in claim 14 wherein the precision optical target comprises at least three concentric sub-targets. 23. The method as in claim 22 wherein the three concentric sub-targets are each concentric ellipses. 24. The method as in claim 22 wherein the computer processor is programmed to calculate centroids of each sub-target by dividing (a) a sum of a product of pixel intensity and pixel position by (b) a sum of pixel intensity in a sub-pixel array. 25. The method as in claim 24 wherein the pixel array is about 48×48 pixels. 26. The system as in claim 4 wherein the computer processor is programmed with algorithms adapted to perform the iteration procedure in steps comprising the following steps: I) Locate the positions of the three target centroids on each of the two Cameras and calculate six principal quantities: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT;II) Make an initial guess of (0, 0, 0, 0, 0, 0) for the subject displacements and rotations (φ, θ, ψ, Δx, Δy, Δz) leading to those centroid positions;III) Enter the guess values for (φ, θ, ψ, Δx, Δy, Δz) into a translation matrix and calculate the corresponding translated 3-D target position (xi, yi, zi) for each of the three target centroids;IV) Calculate the position (horizontal and vertical pixel number) of the projection of each of the three target centroids calculated in Step III on each camera system;V) Calculate six principal quantities using Step IV data from the two cameras: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT;VI) Compare these six calculated principal quantities with measured values from Step I, List the differences as a matrix of errors in the guessed/calculated quantities relative to the measured quantities: (σΣHD,σΔHD,σΣVD,σΔBL,σΣMT,σΔMT);VII) Determine the local partial derivatives of: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT by repeating Steps III-V six times with small added displacements in each degree of freedom, one at a time;VIII) Determine a coarse correction matrix by dividing the error matrix by the derivative matrix, to improve the initial guess and reduce the residual error, Create a better displacement matrix: [φ+Δφ,θ+Δθ,ψ+Δψ,Δx+Δ(Δx),Δy+Δ(Δy),Δz+Δ(Δz)];IX) Repeat steps III through VIII for a second and final iteration, starting with the coarse-corrected displacement matrix computed in Step VIII as the input for Step III; andX) After each successive camera frame increment, repeat Steps I-IX but use the result of previous Step IX for the guess in Step II. 27. The method as in claim 14 wherein the computer processor is programmed with algorithms adapted to perform the iteration procedure in steps comprising the following steps: I) Locate the positions of the three target centroids on each of the two Cameras and calculate six principal quantities: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT;II) Make an initial guess of (0, 0, 0, 0, 0, 0) for the subject displacements and rotations (φ, θ, ψ, Δx, Δy, Δz) leading to those centroid positions;III) Enter the guess values for (φ, θ, Δx, Δx, Δy, Δz) into a translation matrix and calculate the corresponding translated 3-D target position (xi, yi, zi) for each of the three target centroids;IV) Calculate the position (horizontal and vertical pixel number) of the projection of each of the three target centroids calculated in Step III on each camera system;V) Calculate six principal quantities using Step IV data from the two cameras: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT;VI) Compare these six calculated principal quantities with measured values from Step I, List the differences as a matrix of errors in the guessed/calculated quantities relative to the measured quantities: (σΣHD,σΔHD,σΣVD,σΔBL,σΣMT,σΔMT);VII) Determine the local partial derivatives of: ΣHD ΔHD ΣVD ΔBL ΣMT ΔMT by repeating Steps III-V six times with small added displacements in each degree of freedom, one at a time;VIII) Determine a coarse correction matrix by dividing the error matrix by the derivative matrix, to improve the initial guess and reduce the residual error, Create a better displacement matrix: [φ+Δφ,θ+Δθ,ψ+Δψ,Δx+Δ(Δx),Δy+Δ(Δy),Δz+Δ(Δz)];IX) Repeat steps III through VIII for a second and final iteration, starting with the coarse-corrected displacement matrix computed in Step VIII as the input for Step III; and After each successive camera frame increment, repeat Steps I-IX but use the result of previous Step IX for the guess in Step II.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (269)
Bewersdorf, Joerg; Juette, Manuel F.; Gould, Travis; Hess, Sam T., 3D biplane microscopy.
Gupta, Sandeep N.; Beache, Garth M.; Herzka, Daniel A., Analysis of cardic MR relaxation time images with application to quantifying myocardial perfusion reserve indexes.
Macguire, Jr., Francis J., Apparatus, methods providing a signal having successive computer-generated images with a reference frame in correspondence with a reference frame of images with a moving point of view of a device navigated in an object space and providing storage media storing the signal for subsequent playback.
Stirling, Harold Dan; Shears, Jay Allan; Cusey, Lee Norman, Apparatus, systems, and methods for gathering and processing biometric and biomechanical data.
Knopp, Carl F.; Fountain, William D.; Orkiszewski, Jerzy; Persiantsev, Michael; Sklar, H. Alfred; Wysopal, Jan, Automated laser workstation for high precision surgical and industrial interventions.
Tsin, Yanghai; Kirchberg, Klaus J.; Lauritsch, Günter; Xu, Chenyang; Boese, Jan; Liao, Rui, Automatic measurement of morphometric and motion parameters of the coronary tree from a rotational X-ray sequence.
Senior, Andrew William; Pankanti, Sharathchandra; Hampapur, Arun; Brown, Lisa Marie; Tian, Ying-Li, Automatic multiscale image acquisition from a steerable camera.
Senior, Andrew William; Pankanti, Sharathchandra; Hampapur, Arun; Brown, Lisa Marie; Tian, Ying-Li, Automatic multiscale image acquisition from a steerable camera.
Markovic, Relja; Latta, Stephen G; Geisner, Kevin A; Vuchetich, Christopher; Bennett, Darren A; Murphy, Brian S; Wright, Shawn C, Directed performance in motion capture system.
Conwell, Richard L.; Bai, Chuanyong, Discrete sampling of gamma ray field over multiple portions using multiple heads with spaces between the different portions.
Chase, James Geoffrey; Hann, Christopher Eric; Ray, Lawrence Allen, Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system.
Franck Joel I. ; Haer Frederick C. ; Franklin Ronald J. ; Frank Kevin J. ; Clayton John B. ; Henderson Jaimie ; Bucholz Richard D. ; Smith Kurt R. ; Carroll Catalina J., Instrument guidance for stereotactic surgery.
Bridges, Robert E.; Brown, Lawrence B.; West, James K.; Ackerson, D. Scott, Laser tracker and method for measing location and orientation of a patterned target.
Friedman, Marc D.; Accomando, Nicholas A.; Bashir, Faisal; Casaverde, Pablo; Daly, Stephen F.; Hitchcock, David J.; Jose, Romina Marie Johnson; McNerney, Tim; Muller, David; Ruzhitsky, Vladimir; Tosa, Yasunari; Usher, David, Long distance multimodal biometric system and method.
Larsen, Eric J.; Deshpande, Hrishikesh R; Marks, Richard L., Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion.
Saranathan,Manojkumar; Hardy,Christopher J.; Foo,Thomas K. F., Method and apparatus for automated tracking of non-linear vessel movement using MR imaging.
Coveley, Michael; Huang, Yuping, Method and apparatus for cataloging and poling movement in an environment for purposes of tracking and/or containment of infectious diseases.
Ruohonen, Jarmo; Sipilä, Perttu; Hurme, Raine; Ilmoniemi, Risto; Karhu, Jari, Method and apparatus for correcting an error in the co-registration of coordinate systems used to represent objects displayed during navigated brain stimulation.
Csavoy, Andrew N.; Solar, Matthew S.; Waynik, Jeffrey M.; Freas, Mark S.; Miller, Thomas I.; Sootsman, Keith, Method and apparatus for performing a navigated procedure.
Se, Shuen Yan Stephen; Jasiobedzki, Piotr; Parry, David Owen; Jakola, Roy Henry, Method and apparatus for producing 3D model of an underground environment.
Se, Shuen Yan Stephen; Jasiobedzki, Piotr; Parry, David Owen; Jakola, Roy Henry, Method and apparatus for producing an enhanced 3D model of an environment or an object.
Maguire, Jr., Francis J., Method and apparatus for producing and storing, on a resultant non-transitory storage medium, computer generated (CG) video in correspondence with images acquired by an image acquisition device tracked in motion with respect to a 3D reference frame.
Sharma, Rajeev; Mummareddy, Satish; Baboo, Priya; Hershey, Jeff; Jung, Namsoon, Method and system for automatically analyzing categories in a physical space based on the visual characterization of people.
Basson, Sara H.; Kanevsky, Dimitri; Kelley, Edward E.; West, Frances, Method and system for blind spot identification and warning utilizing portable and wearable devices.
Jeung, Andrew; Mostafavi, Hassan; Riaziat, Majid L.; Sutherland, Robert M.; Zdasiuk, George, Method and system for monitoring breathing activity of a subject.
Jeung,Andrew; Mostafavi,Hassan; Riaziat,Majid L.; Sutherland,Robert M.; Zdasiuk,George, Method and system for monitoring breathing activity of a subject.
Jeung,Andrew; Mostafavi,Hassan; Riaziat,Majid L.; Sutherland,Robert M.; Zdasiuk,George, Method and system for monitoring breathing activity of a subject.
El Dokor, Tarek; King, Joshua E; Holmes, James E; Gigliotti, Justin R; Glomski, William E, Method and system for three dimensional interaction of a subject.
El Dokor, Tarek; King, Joshua E; Holmes, James E; Gigliotti, Justin R; Glomski, William E, Method and system for vision-based interaction in a virtual environment.
El Dokor, Tarek; King, Joshua E; Holmes, James E; Gigliotti, Justin R; Glomski, William E, Method and system for vision-based interaction in a virtual environment.
El Dokor, Tarek; King, Joshua E; Holmes, James E; Gigliotti, Justin R; Glomski, William E, Method and system for vision-based interaction in a virtual environment.
El Dokor, Tarek; King, Joshua T.; Holmes, James E.; Gigliotti, Justin R.; Glomski, William E., Method and system for vision-based interaction in a virtual environment.
Kaiser, Daniel R.; Neidert, Michael R.; Skadsberg, Nicholas David; Gardeski, Kenneth C.; Mulligan, Lawrence J.; Kelley, James F.; Shelton, Michael B.; Fischer, Trent M., Methods and systems for use in selecting cardiac pacing sites.
Grycewicz, Thomas J, Methods for estimating peak location on a sampled surface with improved accuracy and applications to image correlation and registration.
Ernst, Thomas Michael; Prieto, Thomas Edmund; Armstrong, Brian Stewart Randall, Motion tracking system for real time adaptive imaging and spectroscopy.
Ernst, Thomas Michael; Prieto, Thomas Edmund; Armstrong, Brian Stewart Randall, Motion tracking system for real time adaptive imaging and spectroscopy.
Ernst, Thomas Michael; Prieto, Thomas Edmund; Armstrong, Brian Stewart Randall, Motion tracking system for real time adaptive imaging and spectroscopy.
Sarin, Vineet Kumar; Pratt, Clyde Ronald; Apgar, Mark Edward; Pratt, William Ralph, Non-imaging, computer assisted navigation system for hip replacement surgery.
Schroeder, John Howison; Kiderman, Alexander D; Joos, Thomas C.; Wuyts, Floris L.; Moore, Steven T; MacDougall, Hamish G, Portable modular video oculography system and video occulography system with head position sensor and video occulography system with animated eye display.
Kuroda,Kagayaki, Self-referencing/body motion tracking non-invasive internal temperature distribution measurement method and apparatus using magnetic resonance tomographic imaging technique.
Zhou, Hanning; Liu, Qiong; Kimber, Donald; Wilcox, Lynn; Cooper, Matthew L., System and method for analyzing and monitoring 3-D video streams from multiple cameras.
Sun, Yiyong; Azar, Fred S.; Xu, Chenyang; Sauer, Frank; Rahn, Norbert, System and method for automatically registering three dimensional cardiac images with electro-anatomical cardiac mapping data.
Lavallee, Stephane; Granchi, Carinne; Vertallier, Laurence; Plaskos, Christopher, System and method for determining an optimal type and position of an implant.
Zhou, Hanning; Liu, Qiong; Kimber, Donald; Wilcox, Lynn; Cooper, Matthew L., System and method for user monitoring interface of 3-D video streams from multiple cameras.
Aota, Kazuyuki; Kimura, Yasunari; Morioka, Mikio; Sugiura, Masataka; Ueda, Junko; Mukai, Arata, Tag sensor system and sensor device, and object position estimating device and object position estimating method.
Liang, Yiqing; Kobla, Vikrant; Bai, Xuesheng; Zhang, Yi; Crnic, Linda S; Wilks, legal representative, Stan L.; Wolf, Wayne, Unified system and method for animal behavior characterization from top view using video analysis.
Harrington, Nathan John, Upper troposphere and lower stratosphere wind direction, speed, and turbidity monitoring using digital imaging and motion tracking.
Sabol, Bruce M.; Melton, R. Eddie, Using video-based imagery for automated detection, tracking, and counting of moving objects, in particular those objects having image characteristics similar to background.
Ernst, Thomas Michael; Prieto, Thomas Edmund; Armstrong, Brian Stewart Randall, Motion tracking system for real time adaptive imaging and spectroscopy.
Ernst, Thomas Michael; Keating, Brian; Singh, Aditya; Zaitsev, Maxim; Herbst, Michael, Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan.
Yu, Jeffrey N.; Alameida, Jr., William Herman; Lovberg, John Arthur; Pan, Xiaojiang Jason; Engelmann, Michael, Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan.
Yu, Jeffrey N.; Lovberg, John Arthur; Pan, Xiaojiang Jason, Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan.
Ernst, Thomas Michael; Zahneisen, Benjamin Anton; Yu, Jeffrey N., Systems, methods, and devices for removing prospective motion correction from medical imaging scans.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.