Virtual measurement tool for minimally invasive surgery
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
A61B-005/103
A61B-005/117
G06F-019/00
A61B-019/00
A61B-018/14
A61B-017/28
A61B-008/08
A61B-017/00
A61B-008/00
A61B-005/107
출원번호
US-0485545
(2009-06-16)
등록번호
US-9155592
(2015-10-13)
발명자
/ 주소
Itkowitz, Brandon D.
Zhao, Tao
Dimaio, Simon
Zhao, Wenyi
Hasser, Christopher J.
Curet, Myriam J.
Mohr, Catherine J.
Stein, Hubert
출원인 / 주소
Intuitive Surgical Operations, Inc.
인용정보
피인용 횟수 :
3인용 특허 :
70
초록▼
Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information
Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information from stereoscopic images. Two or more discrete points can be designated in three dimensions so as to provide a cumulative length along a straight or curving structure, an area measurement, a volume measurement, or the like. The discrete points may be identified by a single surgical tool or by distances separating two or more surgical tools, with the user optionally measuring a structure longer than a field of view of the stereoscopic image capture device by walking a pair of tools “hand-over-hand” along the structure. By allowing the system user to interact with the tissues while designating the tissue locations, and by employing imaging data to determine the measurements, the measurement accuracy and ease of measurement may be enhanced.
대표청구항▼
1. A method for measuring a length along a tissue structure, the method comprising: grasping a first three-dimensional (3-D) location on the tissue structure with a first grasping tool in response to a first command received at a first input command device operatively coupled using one or more proce
1. A method for measuring a length along a tissue structure, the method comprising: grasping a first three-dimensional (3-D) location on the tissue structure with a first grasping tool in response to a first command received at a first input command device operatively coupled using one or more processors to the first grasping tool so as to allow a system user to manipulate the first grasping tool control console; grasping a second 3-D location on the tissue structure with a second grasping tool in response to a second command received at a second input command device operatively coupled using the one or more processors to the second grasping tool so as to allow a system user to manipulate the second grasping tool; configuring the one or more processors to measure, using the one or more processors, three dimensional distances between grasped locations of the tissue structure during hand-over-hand sampling; with the one or more processors, measuring a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; releasing the first grasping tool from grasping the first 3-D location and then grasping a third 3-D location on the tissue structure with the first grasping tool in response to a third command received at the first input command device, the first, second, and third 3-D locations being in sequence along the tissue structure; with the one or more processors, measuring a second three dimensional distance between the second 3-D location and the third 3-D location so as to provide a second three dimensional distance measurement; and with the one or more processors, outputting a sum of the measured first and second three dimensional distances; wherein the tissue structure comprises a tissue structure within a minimally invasive surgical site; and further comprising: grasping a sequence of additional tissue structure locations by alternately moving the first and second grasping tools and grasping the tissue structure alternatingly with the first and second grasping tools in response to commands received at the first and second input command devices; configuring the one or more processors to process stereoscopic image data; and with the one or more processors, receiving stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools; wherein the image is outputted in real time in the course of movement of the first and second grasping tools; and wherein the image includes an image of a stretch line that is superimposed on the image of the tissue structure from a prior grasped tissue location to a currently grasping grasping tool. 2. The method of claim 1, wherein the first 3-D location, the second 3-D location, and the third 3-D location are 3-D tissue locations along the tissue structure, and wherein the 3-D tissue locations are designated by actuation of the grasping tools in response to commands received at the first and second input command devices. 3. The method of claim 2, wherein releasing of the first grasping tool from the first 3-D tissue location while the second grasping tool grasps the second 3-D tissue location designates the second 3-D tissue location, and wherein the designation of the 3-D second tissue location initiates the first three dimensional distance measurement between the first 3-D location and the second 3-D) location. 4. The method of claim 3, wherein releasing of the second grasping tool from the second 3-D tissue location in response to commands received at the second input command device while the first grasping tool grasps the third 3-D tissue location designates the third 3-D tissue location, and wherein the designation of the third 3-D tissue location initiates the second three dimensional distance measurement between the second location and the third location. 5. The method of claim 1, further comprising: with the one or more processors, outputting to a display, an image capture device field of view including the tissue structure, wherein the third location is not visible in the field of view while measuring the first three dimensional distance between the first location and the second location, and manipulating the tissue structure with the grasping tools or moving the field of view in response to commands received at the first and second input command devices so as to output an image of the third location while measuring the second three dimensional distance between the second location and the third location. 6. The method of claim 1, further comprising with the one or more processors, receiving image data comprising left and right stereoscopic images of the tissue structure from an image capture device, wherein the three dimensional distances are measured by determining three dimensional distances between the first and second locations and the second and third locations using the image data. 7. The method of claim 1, wherein the image includes an image of a stretch line that is superimposed on the image of the tissue structure between the currently grasping tool and a currently moving measurement grasping tool. 8. A method for measuring a length along a tissue structure, the method comprising: grasping a first three-dimensional (3-D) location on the tissue structure with a first tool in response to a first command received at a first input command device operatively coupled using one or more processors to the first grasping tool so as to allow a system user to manipulate the first grasping tool control console; grasping a second 3-D location on the tissue structure with a second tool in response to a second command received at a second input command device operatively coupled using the one or more processors to the second grasping tool so as to allow a system user to manipulate the second grasping tool; configuring the one or more processors to measure, using the one or more processors, three dimensional distances between grasped locations of the tissue structure during hand-over-hand sampling; with the one or more processors, measuring a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; releasing the first grasping tool from grasping the first 3-D location and then grasping a third 3-D location on the tissue structure with the first grasping tool in response to a third command received at the first input command device, the first, second, and third 3-D locations being in sequence along the tissue structure; with the one or more processors, measuring a second three dimensional distance between the second 3-D location and the third 3-D location so as to provide a second three dimensional distance measurement; and with the one or more processors, outputting a sum of the measured first and second three dimensional distances; wherein the tissue structure comprises a tissue structure within a minimally invasive surgical site, and further comprising: grasping a sequence a plurality of additional tissue structure locations by alternately moving the first and second grasping tools and grasping the tissue structure alternatingly with the first and second grasping tools in response to commands received at the first and second input command devices; with the one or more processors, measuring a sequence of additional three dimensional distances between a sequence of additional tissue structure 3-D locations so as to provide a sequence of additional three dimensional distance measurements; wherein the three dimensional distances are each defined by a pair of the locations; and further comprising: configuring the one or more processors to process stereoscopic image data, with the one or more processors, during the acts of grasping and releasing with the first and second grasping tools and measuring three-dimensional distances, outputting to a display in real time in the course of movement of the first and second grasping tools: a) a graphical indicator of a measurement location along each grasping tool, b) a stretch line between a measurement location indicated by the graphical indicator along the first grasping tool and a measurement location indicated by the graphical indicator along the second grasping tool, c) a distance measurement between the first and second grasping tools, and d) a current cumulative measurement including the sum of distance measurements for one or more of the additional three dimensional distances, wherein each of a)-d) is superimposed on an image of the minimally invasive surgical site. 9. A method for measuring a length along a tissue structure, the method comprising: grasping a first three-dimensional (3-D) location on the tissue structure with a first tool in response to a first command received at a first input command device operatively coupled using one or more processors to the first grasping tool so as to allow a system user to manipulate the first grasping tool control console; grasping a second 3-D location on the tissue structure with a second tool in response to a second command received at a second input command device operatively coupled using the one or more processors to the second grasping tool so as to allow a system user to manipulate the second grasping tool; configuring the one or more processors to measure, using the one or more processors, three dimensional distances between grasped locations of the tissue structure during hand-over-hand sampling; with the one or more processors, measuring a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; releasing the first grasping tool from grasping the first 3-D location and then grasping a third 3-D location on the tissue structure with the first grasping tool in response to a third command received at the first input command device, the first, second, and third 3-D locations being in sequence along the tissue structure; with the one or more processors, measuring a second three dimensional distance between the second 3-D location and the third 3-D location so as to provide a second three dimensional distance measurement; and with the one or more processors, outputting a sum of the measured first and second three dimensional distances; with the one or more processors, receiving stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools; wherein the tissue structure comprises a tissue structure within a minimally invasive surgical site, and further comprising: grasping a sequence a plurality of additional tissue structure locations by grasping the tissue structure alternatingly with the first and second grasping tools in response to commands received at the first and second input command devices; wherein the first 3-D location, the second 3-D location, and the third 3-D location are 3-D tissue locations along the tissue structure; wherein the 3-D tissue locations are designated by actuation of the grasping tools in response to commands received at the first and second input command devices; and wherein while the first tool remains grasped, the second tool is allowed to grasp and release multiple times in response to commands received at the first input command device until a desired tissue location is achieved; wherein a three dimensional distance measurement between the plurality of additional locations is measured by releasing the first tool in response to commands received at the first input command device while the second grasping tool grasps the desired tissue location; and wherein location designation responsibility between the first grasping tool and the second grasping tool switches when the first grasping tool is released. 10. A method for measuring a length along a tissue structure, the method comprising: grasping a first three-dimensional (3-D) location on the tissue structure with a first tool in response to a first command received at a first input command device operatively coupled using one or more processors to the first grasping tool so as to allow a system user to manipulate the first grasping tool control console; grasping a second 3-D location on the tissue structure with a second tool in response to a second command received at a second input command device operatively coupled using the one or more processors to the second grasping tool so as to allow a system user to manipulate the second grasping tool; configuring the one or more processors to measure, using the one or more processors, three dimensional distances between grasped locations of the tissue structure during hand-over-hand sampling; with the one or more processors, measuring a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; releasing the first grasping tool from grasping the first 3-D location and then grasping a third 3-D location on the tissue structure with the first grasping tool in response to a third command received at the first input command device, the first, second, and third 3-D locations being in sequence along the tissue structure; with the one or more processors, measuring a second three dimensional distance between the second 3-D location and the third 3-D location so as to provide a second three dimensional distance measurement; and with the one or more processors, outputting a sum of the measured first and second three dimensional distances; with the one or more processors, receiving stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools; wherein the tissue structure comprises a tissue structure within a minimally invasive surgical site, and further comprising: grasping a sequence a plurality of additional tissue structure locations by grasping the tissue structure alternatingly with the first and second grasping tools in response to commands received at first and second input command devices; further comprising: manipulating the tissue structure with the grasping tools in response to commands received at the first and second input command devices so as to straighten or stretch a length of the tissue structure when an associated three dimensional distance between the first and second grasping tools is measured. 11. A system to measure a length along a tissue structure, the system comprising: a manipulator coupled using one or more processors to manipulate a first grasping tool in response to movement commands and coupled using the one or more processors to manipulate a second grasping tool in response to movement commands; the one or more processors are configured to: receive a first command to grasp a first 3-D location on the tissue structure with the first grasping tool and in response to receiving the first command, to determine and transmit an associated first instruction to a manipulator system coupled with the first grasping tool; receive a second command to grasp a second 3-D location on the tissue structure with the second grasping tool and in response to receiving the second command, to determine and transmit an associated second instruction to the manipulator system coupled with the second grasping tool; measure, using the one or more processors, a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; and couple the grasping tools to an output such that an input command from a user induces the one or more processors to sum three-dimensional distances between the 3-D locations so as to measure a hand-over-hand length along the tissue structure; wherein the one or more processors designates the second 3-D tissue location, currently grasped by the second grasping tool as a grasping location, in response to commands to release jaws of the first grasping tool from the first 3-D location; and wherein the one or more processors adds the first three dimensional distance measurement between the first 3-D location and the second 3-D location to the hand-over-hand length after designating the second tissue 3-D location as the grasping location so that the first grasping tool may be commanded to grasp and release a plurality of candidate third tissue 3-D locations without altering the hand-over-hand length; and the one or more processors configured to receive stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools. 12. A system to measure a length along a structure, the system comprising: a manipulator coupled using one or more processors to manipulate a first grasping tool in response to movement commands and coupled using the one or more processors to manipulate a second grasping tool in response to movement commands; the one or more processors configured to: receive a first command to grasp a first 3-D location on the tissue structure with the first grasping tool and in response to receiving the first command, to determine and transmit an associated first instruction to a manipulator system coupled with the first grasping tool; receive a second command to grasp a second 3-D location on the tissue structure with the second grasping tool and in response to receiving the second command, to determine and transmit an associated second instruction to the manipulator system coupled with the second grasping tool; measure, using the one or more processors, a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; and couple the grasping tools to an output such that an input command from a user induces the one or more processors to sum three dimensional distances between the 3-D locations so as to measure a hand-over-hand length along the tissue structure; wherein the one or more processors is configured to defer a summation of three dimensional distances until a 3-D location is indicated per a command from the user so as to manipulate the tissue structure with the grasping tools during measurement of the hand-over-hand length and allow the grasping tools to straighten or stretch a measured length of the tissue structure when an associated distance between the first and second grasping tools is measured; and the one or more processors configured to receive stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools. 13. A system to measure a length along a structure, the system comprising: a manipulator coupled using one or more processors to manipulate a first grasping tool in response to movement commands and coupled using the one or more processors to manipulate a second grasping tool in response to movement commands; the one or more processors configured to: receive a first command to grasp a first 3-D location on the tissue structure with the first grasping tool and in response to receiving the first command, to determine and transmit an associated first instruction to a manipulator system coupled with the first grasping tool; receive a second command to grasp a second 3-D location on the tissue structure with the second grasping tool and in response to receiving the second command, to determine and transmit an associated second instruction to the manipulator system coupled with the second grasping tool; measure, using the one or more processors, a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; and couple the grasping tools to an output such that an input command from a user induces the processor to sum three dimensional distances between the 3-D locations so as to measure a hand-over-hand length along the tissue structure; wherein the one or more processors is further configured to output an image capture device field of view to a display; wherein the one or more processors is configured to receive and execute commands for articulation of the tools to grasp and manipulate the structure so as to bring a third 3-D location on the tissue structure into the field of view, and after the third 3-D location on the structure is in the field of view, to determine a distance between the second 3-D location and the third 3-D location; and the one or more processors configured to receive stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools. 14. A system to measure a length along a structure, the system comprising: a manipulator coupled using one or more processors to manipulate a first grasping tool in response to movement commands and coupled using the one or more processors to manipulate a second grasping tool in response to movement commands; the one or more processors configured to: receive a first command to grasp a first 3-D location on the tissue structure with the first grasping tool and in response to receiving the first command, to determine and transmit an associated first instruction to a manipulator system coupled with the first grasping tool; receive a second command to grasp a second 3-D location on the tissue structure with the second grasping tool and in response to receiving the second command, to determine and transmit an associated second instruction to the manipulator system coupled with the second grasping tool; measure, using the one or more processors, a first three dimensional distance between the first 3-D location and the second 3-D location so as to provide a first three dimensional distance measurement; and couple the grasping tools to an output such that an input command from a user induces the one or more processors to sum three dimensional distances between the 3-D locations so as to measure a hand-over-hand length along the tissue structure; wherein the one or more processors is configured to determine and transmit instructions to the manipulator system to grasp and release multiple times using the second grasping tool, in response to received commands, until a desired tissue 3-D location is achieved; wherein a distance measurement between the additional 3-D locations is measured in response to release of the first grasping tool while the second tool grasps the desired 3-D tissue location; and wherein 3-D location designation responsibility between the first grasping tool and the second grasping tool switches in response to release of the first grasping tool, and the one or more processors configured to receive stereoscopic image data comprising left and right stereoscopic images of the tissue structure and of the first and second grasping tools from an image capture device and outputting to a display an image of the tissue structure and of the first and second grasping tools and of a representation of the measured first and second three dimensional distances; wherein the image is outputted in real time in the course of movement of the first and second grasping tools.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (70)
Weiglhofer, Gerhard; Pauker, Fritz; Henkel, Rolf, 3D stereo real-time sensor system, method and computer program therefor.
Robinson, David; Nixon, Thomas R.; Hanuschik, Michael; Goldberg, Randal P.; Hemphill, Jason; Larkin, David Q.; Millman, Paul, Adaptable integrated energy control system for electrosurgical tools in robotic surgical systems.
Moll, Frederic H.; Rosa, David J.; Ramans, Andris D.; Blumenkranz, Stephen J.; Guthart, Gary S.; Niemeyer, Gunter D.; Nowlin, William C.; Salisbury, Jr., J. Kenneth; Tierney, Michael J.; Mintz, David, Arm cart for telerobotic surgical system.
Gunter D. Niemeyer ; Gary S. Guthart ; William C. Nowlin ; Nitish Swarup ; Gregory K. Toth ; Robert G. Younge, Camera referenced control in a minimally invasive surgical apparatus.
Niemeyer,Gunter D.; Guthart,Gary S.; Nowlin,William C.; Swarup,Nitish; Toth,Gregory K; Younge,Robert G., Camera referenced control in a minimally invasive surgical apparatus.
Salisbury, Jr., J. Kenneth; Niemeyer, Gunter D.; Younge, Robert G.; Guthart, Gary S.; Mintz, David S.; Cooper, Thomas G., Devices and methods for presenting and regulating auxiliary information on an image display of a telesurgical system to assist an operator in performing a surgical procedure.
Banker Robert O. (Cumming GA) Ith Cham (Duluth GA) Bacon Kinney C. (Lawrenceville GA) Burleson David B. (Roswell GA), Display system for selectively overlaying symbols and graphics onto a video signal.
Zhao, Wenyi; Wu, Chenyu; Hirvonen, David; Hasser, Christopher J.; Miller, Brian E.; Mohr, Catherine J.; Curet, Myrian J.; Zhao, Tao; Di Maio, Simon; Hoffman, Brian D., Efficient 3-D telestration for local robotic proctoring.
Cavallaro, Richard H.; Gloudemans, James R.; Lazar, Matthew T.; Meier, Kevin R.; Mozes, Alon; Peon, Roberto J.; Steinberg, Eric M., Enhancing video using a virtual surface.
Wang Yulun ; Uecker Darrin R. ; Jordan Charles S. ; Wright James W. ; Laby Keith Phillip ; Wilson Jeff D., Method and apparatus for performing minimally invasive cardiac procedures.
Han Chia Y. (Hamilton County OH) Porembka David T. (Boone County KY) Lin Kwun-Nan (Fayette County KY), Method for automatic contour extraction of a cardiac image.
Chang, William H. L.; Hameed, Salmaan; Mahadik, Amit A.; Javadekar, Kiran A.; Abello, Oretho F., Multi-function image and video capture device for use in an endoscopic camera system.
Philip C. Evans ; Frederic H. Moll ; Gary S. Guthart ; William C. Nowlin ; Rand P. Pendleton ; Christopher P. Wilson ; Andris D. Ramans ; David J. Rosa ; Volkmar Falk ; Robert G. Younge, Performing cardiac surgery without cardioplegia.
William C. Nowlin ; Gary S. Guthart ; J. Kenneth Salisbury, Jr. ; Gunter D. Niemeyer, Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery.
Tierney, Michael J.; Cooper, Thomas; Julian, Chris; Blumenkranz, Stephen J.; Guthart, Gary S.; Younge, Robert G., Surgical robotic tools, data architecture, and use.
Touzawa, Yoshito; Nishigaki, Morio; Hagiwara, Hisashi, System for accurately obtaining a contour and/or quantitative information from an echo image with reduced manual operation.
Madhani Akhil J. ; Salisbury J. Kenneth, Wrist mechanism for surgical instrument for performing minimally invasive surgery with enhanced dexterity and sensitiv.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.