System and method for controlling a remote medical device guidance system in three-dimensions using gestures
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06T-019/00
A61B-005/042
G06F-003/01
A61B-019/00
출원번호
US-0692356
(2012-12-03)
등록번호
US-9439736
(2016-09-13)
발명자
/ 주소
Olson, Eric S.
출원인 / 주소
St. Jude Medical, Atrial Fibrillation Division, Inc.
대리인 / 주소
Dykema Gossett PLLC
인용정보
피인용 횟수 :
4인용 특허 :
89
초록▼
A system for enabling a user to remotely control a robotic medical device system includes a motion capture apparatus to capture motion of a user in a sensing volume and generate indicative output data. The system includes a control unit configured to execute gesture recognition logic that recognizes
A system for enabling a user to remotely control a robotic medical device system includes a motion capture apparatus to capture motion of a user in a sensing volume and generate indicative output data. The system includes a control unit configured to execute gesture recognition logic that recognizes a user gesture based on analysis of the indicative output data. The control unit executes interpreter logic that is configured to translate the recognized user gesture into a corresponding robotic medical device control command configured to control an aspect of the operation of the robotic medical device system.
대표청구항▼
1. A system for enabling a user to remotely control a robotic medical device system, comprising: a motion capture apparatus configured to capture motion of a user in a sensing volume and generate output data indicative of the captured user motion, wherein said output data includes fiducial point tra
1. A system for enabling a user to remotely control a robotic medical device system, comprising: a motion capture apparatus configured to capture motion of a user in a sensing volume and generate output data indicative of the captured user motion, wherein said output data includes fiducial point tracking data, and wherein said fiducial point tracking data is associated with a plurality of fiducial points defined with respect to the user, and wherein said fiducial point tracking data includes, for each fiducial point, a respective position, and wherein each position includes a respective three-dimensional coordinate in a reference coordinate system, and wherein said fiducial point tracking data further includes, for each fiducial point, a respective time-based plurality of positions;an electronic control unit including a processor and a memory;gesture recognition logic stored in said memory and configured to execute on said processor, said gesture recognition logic being configured to recognize a user gesture based on said output data from said motion capture apparatus; andinterpreter logic stored in said memory and configured to execute on said processor, said interpreter logic being configured to translate the user gesture to a corresponding robotic medical device control command wherein said command is configured to control an aspect of the operation of the robotic medical device system, said electronic control unit being configured to communicate said command to the robotic medical device system, and wherein said gesture recognition logic is configured to:identify a start pose based on said fiducial point tracking data;record the motion of a predetermined plurality of fiducial points after the start pose until an end pose is identified based on said fiducial point tracking data;compare said recorded motion of the predetermined plurality of fiducial points with a plurality of predefined gestures; andoutput the user gesture when said recorded motion matches one of the plurality of gestures. 2. The system of claim 1 wherein the start pose corresponds to a start condition where a first set of fiducial points assumes a first relationship therebetween, and the end pose corresponds to an end condition where a second set of fiducial points assumes a second relationship therebetween. 3. The system of claim 1 further comprising a user-actuatable switch coupled to said electronic control unit and having a normally open state, and a user-actuatable closed state, wherein said electronic control unit is configured to at least disable said communication of said command to the robotic medical device system unless said switch is in said closed state. 4. The system of claim 1 wherein said interpreter logic is further configured to selectively translate, based on a state of context switch parameter, the user gesture into one of (i) the robotic medical device control command configured to control an aspect of the operation of the robotic medical device system and (ii) a mapping control command configured to control an aspect of an electro-anatomic mapping system. 5. The system of claim 4 wherein the sensing volume includes a context switching portion, said system for enabling the user to remotely control further comprising context switching logic stored in said memory and configured for execution by said processor and configured to detect a predetermined context switching gesture based on said output data from said motion capture apparatus originating with user-motion occurring in the context switching portion of the sensing volume. 6. The system of claim 1 wherein said output data further includes acquired imaging of the movements of the user. 7. The system of claim 1 wherein said motion capture apparatus comprises an optical sub-system configured to optically detect the motion of the user in the sensing volume. 8. The system of claim 1 wherein said robotic medical device system includes a medical device comprising one of a catheter and a sheath, and wherein said robotic medical device system further includes a manipulator assembly including at least one electrically-operated actuation unit configured for one of translation, deflection and rotation of said medical device. 9. A system for enabling a user to remotely control a robotic medical device system, comprising: a motion capture apparatus configured to capture motion of a user in a sensing volume and generate output data indicative of the captured user motion, wherein said output data includes fiducial point tracking data, and wherein said fiducial point tracking data is associated with a plurality of fiducial points defined with respect to the user, and wherein said fiducial point tracking data includes, for each fiducial point, a respective position;an electronic control unit including a processor and a memory;gesture recognition logic stored in said memory and configured to execute on said processor, said gesture recognition logic being configured to recognize a user gesture based on said output data from said motion capture apparatus; andinterpreter logic stored in said memory and configured to execute on said processor, said interpreter logic being configured to translate the user gesture to a corresponding robotic medical device control command wherein said command is configured to control an aspect of the operation of the robotic medical device system, said electronic control unit being configured to communicate said command to the robotic medical device system, wherein a characteristic associated said robot medical device control command is a commanded magnitude associated with an action involving one of a catheter and a sheath under control of the robotic medical device system, and wherein the commanded magnitude corresponds to a distance between preselected fiducial points. 10. The system of claim 9 wherein the action is selected from the group comprising a catheter extension, a catheter retraction, a sheath extension, and a sheath retraction. 11. The system of claim 9 wherein said robotic medical device system includes a medical device comprising one of a catheter and a sheath, and wherein said robotic medical device system further includes a manipulator assembly including at least one electrically-operated actuation unit configured for one of translation, deflection and rotation of said medical device. 12. A system for enabling a user to remotely control a robotic medical device system, comprising: a motion capture apparatus configured to capture motion of a user in a sensing volume and generate output data indicative of the captured user motion, wherein said output data includes fiducial point tracking data, wherein said fiducial point tracking data is associated with a plurality of fiducial points defined with respect to the user, and wherein said fiducial point tracking data includes, for each fiducial point, a respective position;an electronic control unit including a processor and a memory;gesture recognition logic stored in said memory and configured to execute on said processor, said gesture recognition logic being configured to recognize a user gesture based on said output data from said motion capture apparatus; andinterpreter logic stored in said memory and configured to execute on said processor, said interpreter logic being configured to translate the user gesture to a corresponding robotic medical device control command wherein said command is configured to control an aspect of the operation of the robotic medical device system, said electronic control unit being configured to communicate said command to the robotic medical device system;wherein a characteristic associated with the robot medical device control command is a commanded rotation associated with an action involving one of a catheter and a sheath under control of the robotic medical device system, and wherein the commanded rotation corresponds to a rotation angle through which a preselected fiducial point is rotated during the user gesture. 13. The system of claim 12 wherein said robotic medical device system includes a medical device comprising one of a catheter and a sheath, and wherein said robotic medical device system further includes a manipulator assembly including at least one electrically-operated actuation unit configured for one of translation, deflection and rotation of said medical device. 14. A system for enabling a user to remotely control a robotic medical device system, comprising: a motion capture apparatus configured to capture motion of a user in a sensing volume and generate output data indicative of the captured user motion;an electronic control unit including a processor and a memory;gesture recognition logic stored in said memory and configured to execute on said processor, said gesture recognition logic being configured to recognize a user gesture based on said output data from said motion capture apparatus; andinterpreter logic stored in said memory and configured to execute said processor, said interpreter logic being configured to translate the user gesture to a corresponding robotic medical device control command wherein said command is configured to control an aspect of the operation of the robotic medical device system, said electronic control unit being configured to communicate said command to the robotic medical device system, wherein said interpreter logic is further configured to selectively translate, based on a state of context switch parameter, the user gesture into one of (i) the robotic medical device control command configured to control an aspect of the operation of the robotic medical device system and (ii) a mapping control command configured to control an aspect of an electro-anatomic mapping system, and wherein said interpreter logic is further configured to generate said robotic medical device control command with respect to the visible orientation of the then-visible view of an anatomical model of at least a portion of a body of a patient produced by the electro-anatomic mapping system. 15. The system of claim 14 wherein said robotic medical device system includes a medical device comprising one of a catheter and a sheath, and wherein said robotic medical device system further includes a manipulator assembly including at least one electrically-operated actuation unit configured for one of translation, deflection and rotation of said medical device. 16. A system for enabling a user to remotely control a robotic medical device system, comprising: motion capture means for capturing motion of a user in a sensing volume and generating output data indicative of the captured user motion;gesture recognition means for recognizing a user gesture based on said output data from said motion capture means;interpreter means for translating the user gesture to a corresponding robotic medical device control command wherein said command is configured to control an aspect of the operation of the robotic medical device system; andcommunication means for communicating said command to the robotic medical device system, and wherein said output data includes fiducial point tracking data associated with a plurality of fiducial points defined with respect to the user, and wherein said fiducial point tracking data includes, for each fiducial point, a respective position, wherein each position includes a respective three-dimensional coordinate in a reference coordinate system, and wherein said fiducial point tracking data further includes, for each fiducial point, a respective time-based plurality of positions, and wherein said gesture recognition means is further configured for:identifying a start pose based on said fiducial point tracking data;recording the motion of a predetermined plurality of fiducial points after the start pose until an end pose is identified based on said fiducial point tracking data;comparing said recorded motion of the predetermined plurality of fiducial points with a plurality of predefined gestures; andoutputting the user gesture when said recorded motion matches one of the plurality of gestures. 17. The system of claim 16 wherein said robotic medical device system includes a medical device comprising one of a catheter and a sheath, and wherein said robotic medical device system further includes a manipulator assembly including at least one electrically-operated actuation unit configured for one of translation, deflection and rotation of said medical device.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (89)
Dudney,Joshua L.; Goblish, Jr.,Donald George; Butler,William Emerson, Actuation handle for a catheter.
Rosenberg Louis B. (Mountain View CA), Computer interface or control input device for laparoscopic surgical instrument and other elongated mechanical objects.
Advani Hira (Austin TX) Terrell William L. (Austin TX), Configuration capability for devices in an open system having the capability of adding or changing devices by user comma.
Frosch Robert A. Administrator of the National Aeronautics and Space Administration ; with respect to an invention of ( Palo Alto CA) Salisbury ; Jr. John K. (Palo Alto CA), Controller arm for a remotely related slave arm.
Ohm Timothy ; Das Hari ; Guillermo Rodriguez ; Boswell Curtis ; Paljug Eric ; Schenker Paul ; Barlow Ed ; Steve Charles, Decoupled six degree-of-freedom teleoperated robot system.
Taylor Steven R. (Salt Lake City UT) Lampropoulos Fred P. (Salt Lake City UT) Stout Thomas D. (Sandy UT) Stevens Brian W. (Pleasant Grove UT) Nelson Arlin D. (Midvale UT) Durham Christopher L. (Salt , Detachable and reusable digital control unit for monitoring balloon catheter data in a syringe inflation system.
Madhani Akhil J. ; Salisbury J. Kenneth, Force-reflecting surgical instrument and positioning mechanism for performing minimally invasive surgery with enhanced.
Hauck,John A.; Schweitzer,Jeff A.; Craven,Michael; Afonso,Valtino; Cotner,Holly; Callaghan,Frank; Schultz,John, Method and apparatus for catheter navigation and location and mapping in the heart.
Wang Yulun ; Uecker Darrin R. ; Laby Keith P. ; Wilson Jeff D. ; Jordan Charles S. ; Ghodoussi Modjtaba ; Wright James W., Method and apparatus for performing minimally invasive surgical procedures.
Paynter Henry M. (Adams Rd. ; R.R. #1 ; Box 306A Pittsford VT 05763), Method and system employing strings of opposed gaseous-fluid inflatable tension actuators in jointed arms, legs, beams a.
Berkley, Jeffrey J.; Kim, Seahak; Hong, Sungkwan, Method, apparatus, and article for force feedback based on tension control and tracking through cables.
Moll, Frederic H.; Wallace, Daniel T.; Younge, Robert G.; Moore, David F.; Zinn, Michael R.; Martin, Kenneth M.; Niemeyer, Gunter D., Methods using a robotic catheter system.
Greer, Alexander; Sutherland, Garnette; Fielding, Tim; Newhook, Perry, Methods, devices, and systems for non-mechanically restricting and/or programming movement of a tool of a manipulator along a single axis.
Rosenberg,Louis B.; Brave,Scott B., Providing force feedback to a user of an interface device based on interactions of a user-controlled cursor in a graphical user interface.
Colgate Ledward (Evanston IL) Glucksberg Mathew R. (Chicago IL) Grace Kenneth W. (Evanston IL), System for positioning a medical instrument within a biotic structure using a micromanipulator.
DeMaio Joseph (151 Rosemont Ave. Farmingville NY 11738) Radke Kathleen M. (4825 Valley Forge La. Plymouth MN 55442) Tauer James J. (6534 Oakley Dr. Fridley MN 55432), Virtual pivot handcontroller.
Silva, Jonathan; Silva, Jennifer, System and method for virtual reality data integration and visualization for 3D imaging and instrument position data.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.