최소 단어 이상 선택하여야 합니다.
최대 10 단어까지만 선택 가능합니다.
다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
NTIS 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
DataON 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
Edison 바로가기다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
Kafe 바로가기국가/구분 | United States(US) Patent 등록 |
---|---|
국제특허분류(IPC7판) |
|
출원번호 | US-0865014 (2007-09-30) |
등록번호 | US-8108072 (2012-01-31) |
발명자 / 주소 |
|
출원인 / 주소 |
|
인용정보 | 피인용 횟수 : 444 인용 특허 : 55 |
In one embodiment of the invention, a method for a robotic system is disclosed to track one or more robotic instruments. The method includes generating kinematics information for the robotic instrument within a field of view of a camera; capturing image information in the field of view of the camera
In one embodiment of the invention, a method for a robotic system is disclosed to track one or more robotic instruments. The method includes generating kinematics information for the robotic instrument within a field of view of a camera; capturing image information in the field of view of the camera; and adaptively fusing the kinematics information and the image information together to determine pose information of the robotic instrument. Additionally disclosed is a robotic medical system with a tool tracking sub-system. The tool tracking sub-system receives raw kinematics information and video image information of the robotic instrument to generate corrected kinematics information for the robotic instrument by adaptively fusing the raw kinematics information and the video image information together.
1. A method for a robotic system, the method comprising: generating kinematics information for a robotic instrument within a field of view of a camera;capturing image information in the field of view of the camera; andadaptively fusing the kinematics information and the image information together to
1. A method for a robotic system, the method comprising: generating kinematics information for a robotic instrument within a field of view of a camera;capturing image information in the field of view of the camera; andadaptively fusing the kinematics information and the image information together to determine pose information of the robotic instrument;wherein the adaptive fusing of the kinematics information and the image information together includes synthesizing an image of a model of the robotic instrument in response to the kinematics information, matching the image of the model to the image information to generate match results, filtering the match results, and forming a plurality of states of the pose information for the robotic instrument in response to the filtered match results and kinematics information. 2. The method of claim 1, wherein the pose information of the robotic instrument includes location and orientation of the robotic instrument with respect to the camera and has a quality greater than the kinematics information alone. 3. The method of claim 1, further comprising: sensing first kinematics information of the robotic instrument at a first position and capturing first image information of the robotic instrument at the first position;sensing second kinematics information of the robotic instrument at a second position and capturing second image information of the robotic instrument at the second position; andwherein the first kinematics information, the first image information, the second kinematics information, and the second image information are adaptively fused together to track the robotic instrument. 4. The method of claim 1, wherein the adaptive fusing of the kinematics information and the image information together includes preferring the kinematics information over the image information in generating the pose information if the image information is unreliable. 5. The method of claim 4, wherein the adaptive fusing of the kinematics information and the image information together further includes preferring the image information over the kinematics information in generating the pose information if the image information is reliable or if the kinematics information is unreliable. 6. The method of claim 1, comprising: if an image of the robotic instrument is unavailable, the method further comprises predicting the pose of the robotic instrument in response to prior information. 7. The method of claim 6, wherein the pose of the robotic instrument is predicted in response to prior kinematics information. 8. The method of claim 7, wherein the pose of the robotic instrument is predicted in further response to current kinematics information. 9. The method of claim 6, wherein the pose of the robotic instrument is predicted in response to prior image information. 10. The method of claim 1, wherein the adaptive fusing of the kinematics information and the image information together includes adaptively fusing together first image information of a first video image source with second image information of a second video image source. 11. The method of claim 1, wherein the matching of the image of the model of the robotic instrument to the image information to generate match results includes reading a computer aided design model of the robotic instrument to determine one or more markers thereof, andanalyzing the image information for the one or more markers to generate a match. 12. The method of claim 11, wherein the one or more markers form a pattern and the match of the one or more markers in the image information is a pattern match. 13. The method of claim 11, wherein the one or more markers are artificial markers. 14. The method of claim 13, wherein the one or more artificial markers are a pattern of dots. 15. The method of claim 11, wherein the one or more markers are natural markers consisting of geometry information of the computer aided design model. 16. The method of claim 1, wherein the camera is a stereo camera and the capturing of image information in the field of view of the camera includes capturing left and right stereo images in the field of view of the stereo camera. 17. The method of claim 1, wherein the camera includes a first camera in a first position over the robotic instrument and a second camera in a second position differing from the first over the robotic instrument, andthe capturing of image information in the field of view of the plurality of cameras includes capturing first images in the field of view of the first camera, andcapturing second images in the field of view of the second camera. 18. The method of claim 1, wherein the robotic instrument includes a marker with a geometric relationship, andthe capturing of image information in the field of view of the camera includes capturing an image of the marker with the geometric relationship to improve image matching. 19. The method of claim 1, wherein the robotics instrument is coupled to a robotic arm of a robotic system to generate the kinematics information. 20. A robotic medical system comprising: a robotic instrument coupled to a robotic arm to be manipulated and generate raw kinematics information;a camera to capture video image information of a portion of the robotic instrument; anda tool tracking sub-system to receive the raw kinematics information and the video image information of the robotic instrument, the tool tracking sub-system to generate corrected kinematics information for the robotic instrument by adaptively fusing the raw kinematics information and the video image information together, wherein the adaptive fusing of the kinematics information and the video image information together includes synthesizing an image of a model of the robotic instrument in response to the kinematics information, matching the image of the model to the video image information to generate match results, filtering the match results, and forming a plurality of states of the pose information for the robotic instrument in response to the filtered match results and kinematics information. 21. The robotic medical system of claim 20, wherein the tool tracking sub-system adaptively fuses the raw kinematics information and the video image information together to localize and automatically track the robotic instrument. 22. The robotic medical system of claim 20, further comprising: a video display coupled to the camera and the tool tracking sub-system, the video display to display an operative image aligned to an image of a tissue surface to guide the robotic instrument into a patient's body. 23. The robotic medical system of claim 22, wherein the operative image is a pre-operative image, andthe pre-operative image is a magnetic resonance image (MRI) of a portion of the patient's body or a computed tomography (CT) image of a portion of the patient's body. 24. The robotic medical system of claim 22, wherein the robotic instrument is an ultrasound probe,the operative image is an intra-operative image, andthe intra-operative image is an ultrasound image of a portion of the patient's body generated by the ultrasound probe.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.