Image capture unit and method with an extended depth of field
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
A61B-001/04
A61B-001/06
A61B-001/00
G02B-023/24
H04N-005/225
H04N-013/02
A61B-001/05
G02B-027/00
G06T-007/571
G06T-007/593
H04N-009/04
H04N-009/097
H04N-013/00
출원번호
US-0262402
(2014-04-25)
등록번호
US-9782056
(2017-10-10)
발명자
/ 주소
McDowall, Ian E.
출원인 / 주소
Intuitive Surgical Operations, Inc.
인용정보
피인용 횟수 :
1인용 특허 :
17
초록▼
In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical stru
In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.
대표청구항▼
1. An apparatus comprising: a first image capture sensor comprising a first image capture sensor surface;a second image capture sensor comprising a second image capture sensor surface, wherein the first image capture sensor surface is in a first plane, the second image capture sensor surface is in a
1. An apparatus comprising: a first image capture sensor comprising a first image capture sensor surface;a second image capture sensor comprising a second image capture sensor surface, wherein the first image capture sensor surface is in a first plane, the second image capture sensor surface is in a second plane, andwherein the first and second planes are substantially parallel and are separated by a known distance,wherein at least one of the first and second image capture sensors comprises a color image capture sensor;a prism assembly, positioned to receive light, comprising: a distal face through which the received light enters the prism assembly;a beam splitter configured to reflect a first portion of the received light, and to transmit a second portion of the received light; anda surface configured to reflect, in a first direction, the first portion of the received light onto the first image capture sensor,wherein a first portion of the received light is a first percentage of the received light, and the second portion of the received light is a second percentage of the received light,wherein one hundred percent minus the first percentage is about the second percentage, andwherein the first and second percentages are not about equal, and the first percentage is smaller than the second percentagea reflective unit positioned to receive the second portion of the received light, the reflective unit being configured to direct, in the first direction, the second portion of the received light to the second image capture sensor, wherein a first optical path length from the distal face to the first image capture sensor surface is smaller than a second optical path length from the distal face to the second image capture sensor surface,wherein the first image capture sensor captures an image focused at a first object distance, andwherein the second image capture sensor captures an image focused at a second object distance; anda controller coupled to the first and second image capture sensors to receive first and second images, the controller being configured to automatically generate an in focus output image from the first and second images, the in focus output image having an extended depth of field, and the controller being configured to sample a first group of pixels in the first image, the controller being configured to sample a corresponding second group of pixels in the second image, and the controller being configured to select one of the first group of pixels and the second group of pixels for the output image. 2. An apparatus comprising: a first image capture sensor comprising a first image capture sensor surface;a second image capture sensor comprising a second image capture sensor surface, wherein the first image capture sensor surface is in a first plane, the second image capture sensor surface is in a second plane, andwherein the first and second planes are substantially parallel and are separated by a known distance,wherein at least one of the first and second image capture sensors comprises a color image capture sensor;a prism assembly, positioned to receive light, comprising: a distal face through which the received light enters the prism assembly;a beam splitter configured to reflect a first portion of the received light, and to transmit a second portion of the received light; anda surface configured to reflect, in a first direction, the first portion of the received light onto the first image capture sensor,wherein a first portion of the received light is a first percentage of the received light, and the second portion of the received light is a second percentage of the received light,wherein one hundred percent minus the first percentage is about the second percentage, andwherein the first and second percentages are not about equal, and the first percentage is smaller than the second percentagea reflective unit positioned to receive the second portion of the received light, the reflective unit being configured to direct, in the first direction, the second portion of the received light to the second image capture sensor, wherein a first optical path length from the distal face to the first image capture sensor surface is smaller than a second optical path length from the distal face to the second image capture sensor surface,wherein the first image capture sensor captures an image focused at a first object distance, andwherein the second image capture sensor captures an image focused at a second object distance; anda controller coupled to the first and second image capture sensors, the controller being configured to retrieve a first image captured by the first image capture sensor and to retrieve a second image captured by the second image capture sensor, and the controller being configured to generate a depth map from the first and second images. 3. The apparatus of claim 2, the controller further being configured to generate a three-dimensional surface of a scene; the controller being configured to project and texture map the first and second images back on the three-dimensional surface to generate a textured image surface; and the controller being configured to generate a new image for a virtual camera point from the depth map and the textured image surface. 4. An apparatus comprising: a first image capture sensor comprising a first image capture sensor surface;a second image capture sensor comprising a second image capture sensor surface, wherein the first image capture sensor surface is in a first plane, the second image capture sensor surface is in a second plane, andwherein the first and second planes are substantially parallel and are separated by a known distance,wherein at least one of the first and second image capture sensors comprises a color image capture sensor;a prism assembly, positioned to receive light, comprising: a distal face through which the received light enters the prism assembly;a beam splitter configured to reflect a first portion of the received light, and to transmit a second portion of the received light; anda surface configured to reflect, in a first direction, the first portion of the received light onto the first image capture sensor,wherein a first portion of the received light is a first percentage of the received light, and the second portion of the received light is a second percentage of the received light,wherein one hundred percent minus the first percentage is about the second percentage, andwherein the first and second percentages are not about equal, and the first percentage is smaller than the second percentagea reflective unit positioned to receive the second portion of the received light, the reflective unit being configured to direct, in the first direction, the second portion of the received light to the second image capture sensor, wherein a first optical path length from the distal face to the first image capture sensor surface is smaller than a second optical path length from the distal face to the second image capture sensor surface,wherein the first image capture sensor captures an image focused at a first object distance, andwherein the second image capture sensor captures an image focused at a second object distance; anda stereoscopic endoscope comprising a distal end, a pair of channels, and a plurality of first and second image capture sensors, prism assemblies, and reflective assemblies,wherein the first image capture sensor, the second image capture sensor, the prism assembly, and the reflective unit are included in the plurality, andwherein each channel in the pair of channels includes, in the distal end of the stereoscopic endoscope, a different first image capture sensor of the plurality, a different second image capture sensor of the plurality, a different prism assembly of the plurality, and a different reflective unit of the plurality. 5. The apparatus of claim 4, further comprising: a controller coupled to the first and second image capture sensors in a first channel of the pair to receive first and second acquired images and coupled to first and second image capture sensors in a second channel of the pair to receive third and fourth acquired images; the controller being configured to generate a first channel depth map for the first channel and to generate a second channel depth map for the second channel; the controller being configured to generate a three-dimensional surface of a scene based on the first and second channel depth maps; the controller being configured to project and texture the first, second, third and fourth acquired images on the three-dimensional surface to generate a textured image surface; and the controller being configured to generate a new image for a new virtual camera view point from the textured image surface.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (17)
Moll, Frederic H.; Rosa, David J.; Ramans, Andris D.; Blumenkranz, Stephen J.; Guthart, Gary S.; Niemeyer, Gunter D.; Nowlin, William C.; Salisbury, Jr., J. Kenneth; Tierney, Michael J.; Mintz, David, Arm cart for telerobotic surgical system.
Takahashi Susumu,JPX ; Nakamura Shinichi,JPX ; Takebayashi Tsutomu,JPX, Stereoscopic endoscope objective lens system having a plurality of front lens groups and one common rear lens group.
Tierney Michael J. ; Cooper Thomas G. ; Julian Chris A. ; Blumenkranz Stephen J. ; Guthart Gary S. ; Younge Robert G., Surgical robotic tools, data architecture, and use.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.