Virtual measurement tool for minimally invasive surgery
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
A61B-017/00
A61B-001/04
A61B-001/00
출원번호
US-0485503
(2009-06-16)
등록번호
US-9492240
(2016-11-15)
발명자
/ 주소
Itkowitz, Brandon D.
Zhao, Tao
Di Maio, Simon
Zhao, Wenyi
Hasser, Christopher J.
Curet, Myrian J.
Mohr, Catherine J.
Stein, Hubert
출원인 / 주소
Intuitive Surgical Operations, Inc.
인용정보
피인용 횟수 :
4인용 특허 :
71
초록▼
Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information
Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information from stereoscopic images. Two or more discrete points can be designated in three dimensions so as to provide a cumulative length along a straight or curving structure, an area measurement, a volume measurement, or the like. The discrete points may be identified by a single surgical tool or by distances separating two or more surgical tools, with the user optionally measuring a structure longer than a field of view of the stereoscopic image capture device by walking a pair of tools “hand-over-hand” along the structure. By allowing the system user to interact with the tissues while designating the tissue locations, and by employing imaging data to determine the measurements, the measurement accuracy and ease of measurement may be enhanced.
대표청구항▼
1. A surgical system for measuring tissue, the system comprising: a first robotic tool having a tool tip;a stereoscopic image capture device orientable toward a surgical site for capturing left and right stereoscopic images of the tissue at the surgical site and capturing left and right stereoscopic
1. A surgical system for measuring tissue, the system comprising: a first robotic tool having a tool tip;a stereoscopic image capture device orientable toward a surgical site for capturing left and right stereoscopic images of the tissue at the surgical site and capturing left and right stereoscopic images of the first robotic tool, the image capture device in use generating stereoscopic image data corresponding to the left and right stereoscopic images of the tissue at the surgical site and the first robotic tool;a stereoscopic display coupled to the image capture device so as to show the captured left and right stereoscopic images of the tissue at the surgical site and the captured left and right stereoscopic images of the first robotic tool to a system user;an input for designating tissue locations indicated by the first robotic tool, wherein the input is coupled to a master controller coupled with the first robotic tool for receiving movement commands from the system user to guide the first robotic tool to designate a first tissue location, with the first robotic tool tip disposed over the first tissue location as seen from a dominant eye of the system user, without touching the first tissue location, the first tissue location having one or more first points of interest within both of the left and right stereoscopic images of the tissue at the surgical site shown on the stereoscopic display; anda processor configured to track Cartesian position of the first robotic tool tip and to match an image of the one or more points of interest within one of the left and right stereoscopic images of the tissue at the surgical site to an image of the one or more points of interest within the other of the left and right stereoscopic images of the tissue at the surgical site, based upon local characteristics of the one or more points of interest, so as to determine a three-dimensional location of the tissue that corresponds to the matched one or more points of interest, wherein the three-dimensional location corresponds to the first designated tissue location indicated by the first robotic tool, and to superimpose a first graphical indicator on the stereoscopic images of the tissue at the determined three-dimensional location of the tissue that corresponds to the matched points of interest, without touching the first designated tissue location, the processor being further configured for generating a measurement between at least the first graphical indicator and a second designated tissue location;wherein the first graphical indicator is superimposed on the stereoscopic images of the tissue at the determined three-dimensional location that corresponds to the matched one or more points of interest, after the first robotic tool is moved to designate the first designated tissue location. 2. The system of claim 1, wherein the processor superimposes a graphical tool measurement marker on the stereoscopic images of the tissue at the surgical site coincident with the first robotic tool while the user guides the first robotic tool to the first designated tissue location. 3. The system of claim 1, wherein the processor is configured to receive tissue designating commands sequentially from the system user so as to facilitate indication of the second designated tissue location with the first robotic tool. 4. The system of claim 1, wherein the processor is configured to receive a tissue designating command from the system user so as to simultaneously indicate the first designated tissue location with the first robotic tool and the second designated tissue location with a second robotic tool. 5. The system of claim 1, wherein the processor couples the input to the stereoscopic display so as to superimpose a moving line extending between the first designated tissue location and the first robotic tool while the system user guides the first robotic tool to the second designated tissue location. 6. The system of claim 5, wherein the processor is configured to determine an offset display location such that the measurement is displayed superimposed on the stereoscopic images of the tissue and separated from the moving line. 7. The system of claim 1, wherein the processor couples the input to the stereoscopic display so as to receive additional input designation commands so as to define an enclosed area, wherein the measurement comprises an area measurement. 8. The system of claim 7, wherein the first designated tissue location and the second designated tissue location comprise discrete locations bordering the enclosed area, with each of the first designated tissue location and the second designated tissue location having an associated location designation. 9. The system of claim 1, wherein the processor determines a three dimensional location of a tissue surface based on the stereoscopic image data, and wherein the processor designates the first designated tissue location by snapping the graphical indicator from the first robotic tool tip to the tissue surface. 10. The system of claim 1, wherein the tissue comprises a physiologically moving tissue, wherein the left and right stereoscopic images of the tissue comprises still stereoscopic images of the moving tissue, the system further comprising a three dimensional input device coupled to the display by the processor so that a three dimensional graphical indicator superimposed on the still stereoscopic images of the moving tissue is positioned using the input device so as to indicate the second designated tissue location. 11. The system of claim 1, wherein the processor derives the measurement at least in part from kinematic data of the first robotic tool. 12. The system of claim 1, wherein the first graphical indicator is configured to appear at a same depth as the tissue at the surgical site. 13. The system of claim 1, wherein the processor is configured to perform region matching to match the image of the one or more points of interest within the one of the left and right stereoscopic images of the tissue at the surgical site to the image of the one or more points of interest within the other of the left and right stereoscopic images of the tissue at the surgical site, based upon local characteristics of the images of the one or more points of interest. 14. The system of claim 1, wherein the processor configured to perform feature matching to match the image of the one or more points of interest within the one of the left and right stereoscopic images of the tissue at the surgical site to the image of the one or more points of interest within the other of the left and right stereoscopic images of the tissue at the surgical site, based upon local characteristics of the images of the one or more points of interest. 15. The system of claim 1, wherein the processor configured to perform feature interpolation to match the image of the one or more first of interest within the one of the left and right stereoscopic images of the tissue at the surgical site to the image of the one or more points of interest within the other of the left and right stereoscopic images of the tissue at the surgical site, based upon local characteristics of the images one or more points of interest. 16. A robotic system for measuring tissue, the system comprising: a first robotic tool having a tool tip;a stereoscopic image capture device orientable toward a surgical site for capturing left and right stereoscopic images of the tissue at the surgical site and capturing left and right stereoscopic images of the first robotic tool, the image capture device in use generating stereographic image data corresponding to the left and right stereoscopic images of the tissue at the surgical site and the first robotic tool;a stereoscopic display coupled to the image capture device so as to show the captured left and right stereoscopic images of the tissue and the captured left and right stereoscopic images of the first robotic tool to a system user;an input for designating tissue locations indicated by the first robotic tool, wherein the input is coupled to a master controller coupled with the first robotic tool for receiving movement commands from the system user to guide the first robotic tool to designate a first tissue location, with the first robotic tool disposed over the first tissue location as seen from a dominant eye of the system user, without touching the tissue location, the first tissue location having one or more points of interest within both of the left and right stereoscopic images of the tissue at the surgical site shown on the stereoscopic display; anda processor configured to track Cartesian position of the first robotic tool tip, and to match an image of the one or more points of interest within one of the left and right stereoscopic images of the tissue at the surgical site to an image of the one or more points of interest within the other of the left and right stereoscopic images of the tissue at the surgical site, based upon local characteristics of the image of the one or more points of interest, so as to determine a three-dimensional location of tissue that corresponds to the matched one or more points of interest, wherein the three-dimensional location corresponds to the first designated tissue location indicated by the first robotic tool and to superimpose a first graphical indicator on the stereoscopic images of the tissue at the determined three-dimensional location that corresponds to the matched one or more points of interest, without touching the first designated tissue location, the processor further configured for generating a measurement between at least the first graphical indicator and a second tissue location,wherein the first graphical indicator is superimposed on the stereoscopic images of the tissue at the determined three-dimensional location after the first robotic tool is moved to designate the first designated tissue location; andwherein the processor couples the input to the stereoscopic display so as to receive additional input designation commands indicating additional tissue locations, so as to determine a plurality of three dimensional offset distances between sequential pairs of tissue locations, and so as to sum the three dimensional offset distances as a cumulative measurement value and superimpose the cumulative measurement value on the stereoscopic images of the tissue at the surgical site. 17. The system of claim 16, further comprising a second robotic tool, wherein the first robotic tool and the second robotic tool each comprises at least one jaw, wherein the movement commands comprises a jaw articulation input for the at least one jaw jaws so that the processor is configured to determine the plurality of three dimensional offset distances by summing offset distances in a hand-over-hand length measurement along the tissue.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (71)
Weiglhofer, Gerhard; Pauker, Fritz; Henkel, Rolf, 3D stereo real-time sensor system, method and computer program therefor.
Robinson, David; Nixon, Thomas R.; Hanuschik, Michael; Goldberg, Randal P.; Hemphill, Jason; Larkin, David Q.; Millman, Paul, Adaptable integrated energy control system for electrosurgical tools in robotic surgical systems.
Moll, Frederic H.; Rosa, David J.; Ramans, Andris D.; Blumenkranz, Stephen J.; Guthart, Gary S.; Niemeyer, Gunter D.; Nowlin, William C.; Salisbury, Jr., J. Kenneth; Tierney, Michael J.; Mintz, David, Arm cart for telerobotic surgical system.
Gunter D. Niemeyer ; Gary S. Guthart ; William C. Nowlin ; Nitish Swarup ; Gregory K. Toth ; Robert G. Younge, Camera referenced control in a minimally invasive surgical apparatus.
Niemeyer,Gunter D.; Guthart,Gary S.; Nowlin,William C.; Swarup,Nitish; Toth,Gregory K; Younge,Robert G., Camera referenced control in a minimally invasive surgical apparatus.
Salisbury, Jr., J. Kenneth; Niemeyer, Gunter D.; Younge, Robert G.; Guthart, Gary S.; Mintz, David S.; Cooper, Thomas G., Devices and methods for presenting and regulating auxiliary information on an image display of a telesurgical system to assist an operator in performing a surgical procedure.
Banker Robert O. (Cumming GA) Ith Cham (Duluth GA) Bacon Kinney C. (Lawrenceville GA) Burleson David B. (Roswell GA), Display system for selectively overlaying symbols and graphics onto a video signal.
Zhao, Wenyi; Wu, Chenyu; Hirvonen, David; Hasser, Christopher J.; Miller, Brian E.; Mohr, Catherine J.; Curet, Myrian J.; Zhao, Tao; Di Maio, Simon; Hoffman, Brian D., Efficient 3-D telestration for local robotic proctoring.
Cavallaro, Richard H.; Gloudemans, James R.; Lazar, Matthew T.; Meier, Kevin R.; Mozes, Alon; Peon, Roberto J.; Steinberg, Eric M., Enhancing video using a virtual surface.
Wang Yulun ; Uecker Darrin R. ; Jordan Charles S. ; Wright James W. ; Laby Keith Phillip ; Wilson Jeff D., Method and apparatus for performing minimally invasive cardiac procedures.
Han Chia Y. (Hamilton County OH) Porembka David T. (Boone County KY) Lin Kwun-Nan (Fayette County KY), Method for automatic contour extraction of a cardiac image.
Chang, William H. L.; Hameed, Salmaan; Mahadik, Amit A.; Javadekar, Kiran A.; Abello, Oretho F., Multi-function image and video capture device for use in an endoscopic camera system.
Philip C. Evans ; Frederic H. Moll ; Gary S. Guthart ; William C. Nowlin ; Rand P. Pendleton ; Christopher P. Wilson ; Andris D. Ramans ; David J. Rosa ; Volkmar Falk ; Robert G. Younge, Performing cardiac surgery without cardioplegia.
William C. Nowlin ; Gary S. Guthart ; J. Kenneth Salisbury, Jr. ; Gunter D. Niemeyer, Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery.
Tierney, Michael J.; Cooper, Thomas; Julian, Chris; Blumenkranz, Stephen J.; Guthart, Gary S.; Younge, Robert G., Surgical robotic tools, data architecture, and use.
Touzawa, Yoshito; Nishigaki, Morio; Hagiwara, Hisashi, System for accurately obtaining a contour and/or quantitative information from an echo image with reduced manual operation.
Madhani Akhil J. ; Salisbury J. Kenneth, Wrist mechanism for surgical instrument for performing minimally invasive surgery with enhanced dexterity and sensitiv.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.