A method for depth mapping includes illuminating an object with a time-coded pattern and capturing images of the time-coded pattern on the object using a matrix of detector elements. The time-coded pattern in the captured images is decoded using processing circuitry embedded in each of the detector
A method for depth mapping includes illuminating an object with a time-coded pattern and capturing images of the time-coded pattern on the object using a matrix of detector elements. The time-coded pattern in the captured images is decoded using processing circuitry embedded in each of the detector elements so as to generate respective digital shift values, which are converted into depth coordinates.
대표청구항▼
1. A method for depth mapping, comprising: illuminating an object with a time-coded pattern;capturing images of the time-coded pattern on the object using a matrix of detector elements;storing reference values corresponding to a reference image of the time-coded pattern at a predefined reference fra
1. A method for depth mapping, comprising: illuminating an object with a time-coded pattern;capturing images of the time-coded pattern on the object using a matrix of detector elements;storing reference values corresponding to a reference image of the time-coded pattern at a predefined reference frame;decoding the time-coded pattern in the captured images using processing circuitry embedded in each of the detector elements by generating respective output words from the detector elements based on the captured images, and taking differences by subtraction between the respective output words and the stored reference values so as to generate respective digital shift values; andconverting the shift values into depth coordinates. 2. The method according to claim 1, wherein illuminating the object comprises projecting a temporal sequence of spatial patterns of light onto the object. 3. The method according to claim 2, wherein the spatial patterns comprise alternating bright and dark stripes, having a different, respective spatial frequency in each of the spatial patterns. 4. The method according to claim 2, wherein the spatial patterns comprise one or more gray-scale patterns. 5. The method according to claim 2, wherein capturing the images comprises capturing multiple successive image frames, and wherein the temporal sequence extends over a given number of the successive image frames, and wherein decoding the time-coded pattern comprises combining signals from the given number of the successive image frames. 6. The method according to claim 2, wherein projecting the temporal sequence comprises: scanning an illumination beam along a first axis, while modulating the beam; andapplying a cylindrical optical element to generate the spatial patterns by spreading the modulated beam along a second axis, perpendicular to the first axis. 7. The method according to claim 2, wherein projecting the temporal sequence comprises: providing a patterned element comprising multiple areas, which when illuminated, created respective ones of the spatial patterns; andilluminating the areas sequentially so as to project the temporal sequence of the spatial patterns. 8. The method according to claim 1, wherein capturing the images comprises generating electrical charge in each of the detector elements responsively to the time-coded pattern, and wherein decoding the pattern comprises switching the charge among different charge storage components in each of the detector elements in synchronization with the timecoded pattern. 9. The method according to claim 8, wherein the temporal sequence and switching the charge are synchronized by a global clock, and wherein decoding the pattern comprises reading data out of the matrix of the detector elements under control of a local clock, which is unsynchronized with the global clock. 10. The method according to claim 9, wherein the matrix comprises multiple rows of the detector elements, and wherein reading the data out comprises outputting the data from the detector elements row by row using a rolling shutter controlled by the local clock. 11. The method according to claim 8, wherein decoding the pattern comprises: making a comparison of the charge stored in each of the charge storage components to a threshold level;generating bit values responsively to the comparison; andconcatenating the bit values to generate the respective digital shift values. 12. The method according to claim 8, wherein decoding the pattern comprises combining signals from the charge storage components in groups of neighboring detector elements so as to provide the depth coordinates with enhanced depth resolution. 13. The method according to claim 1, wherein illuminating the object comprises projecting a temporal sequence of spatial patterns of light onto the object, and wherein capturing the images comprises capturing multiple successive image frames, and the temporal sequence extends over a given number of the successive image frames, andwherein decoding the pattern comprises combining signals from the given number of the successive image frames while combining the signals from groups of neighboring detector elements. 14. The method according to claim 1, wherein converting the shift values comprises generating a depth map of the object by triangulation of the digital shift values. 15. Apparatus for depth mapping, comprising: an illumination subassembly, which is configured to illuminate an object with a time-coded pattern;an image capture subassembly, which comprises: a matrix of detector elements configured to capture images of the time-coded pattern on the object;registers configured to store reference values corresponding to a reference image of the time-coded pattern at a predefined reference frame;processing circuitry, which is embedded in each of the detector elements and is configured to decode the time-coded pattern in the captured images so as to provide respective output words from the detector elements based on the captured images; anda subtracter, which is coupled to take differences between the respective output words and the stored reference values so as to output respective digital shift values; anda processor, which is configured to convert the shift values into depth coordinates. 16. The apparatus according to claim 15, wherein the illumination subassembly is configured to illuminate the object by projecting a temporal sequence of spatial patterns of light onto the object. 17. The apparatus according to claim 16, wherein the spatial patterns comprise alternating bright and dark stripes, having a different, respective spatial frequency in each of the spatial patterns. 18. The apparatus according to claim 16, wherein the spatial patterns comprise one or more grayscale patterns. 19. The apparatus according to claim 16, wherein the image capture assembly is configured to capture multiple successive image frames, and wherein the temporal sequence extends over a given number of the successive image frames, and wherein the processing circuitry is configured to combine the signals from the given number of the successive image frames to generate the shift values. 20. The apparatus according to claim 16, wherein the illumination subassembly comprises: a radiation source, which is configured to generate an illumination beam;scanning optics, which are configured to scan the illumination beam along a first axis while the illumination beam is modulated; anda cylindrical optical element, which is configured to generate the spatial patterns by spreading the modulated beam along a second axis, perpendicular to the first axis. 21. The apparatus according to claim 16, wherein the illumination subassembly comprises: a patterned element comprising multiple areas, which when illuminated, create respective ones of the spatial patterns; andat least one radiation source, which is configured to illuminate the areas sequentially so as to project the temporal sequence of the spatial patterns. 22. The method according to claim 15, wherein the detector elements are configured to generate electrical charge responsively to the time-coded pattern, and wherein the processing circuitry comprises, in each of the detector elements: multiple charge storage components; anda switch which is configured to switch the charge from the detector elements among the charge storage components in synchronization with the time-coded pattern. 23. The apparatus according to claim 22, wherein the temporal sequence and switching the charge are synchronized by a global clock, and wherein the image capture subassembly is configured to read data out of the matrix of the detector elements under control of a local clock, which is unsynchronized with the global clock. 24. The apparatus according to claim 23, wherein the matrix comprises multiple rows of the detector elements, and wherein the data from the detector elements are read out row by row using a rolling shutter controlled by the local clock. 25. The apparatus according to claim 22, wherein the processing circuitry comprises comparator logic, which is configured to make a comparison of the charge stored in each of the charge storage components to a threshold level, to generate bit values responsively to the comparison, and to concatenate the bit values to generate the respective digital shift values. 26. The apparatus according to claim 22, wherein the processing circuitry is configured to combine the signals from the charge storage components in groups of neighboring detector elements so as to provide the depth coordinates with enhanced depth resolution. 27. The method according to claim 15, wherein the illumination subassembly is configured to illuminate the object by projecting a temporal sequence of spatial patterns of light onto the object, and wherein the image capture assembly is configured to capture multiple successive image frames, and the temporal sequence extends over a given number of the successive image frames, andwherein the processor is configured to combine the signals from the given number of the successive image frames while combining the signals from groups of neighboring detector elements. 28. The method according to claim 15, wherein the processor is configured to convert the shift values comprises generating a depth map of the object by triangulation of the digital shift values.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (90)
Matsumoto,Yukinori; Fujimura,Kota; Sugimoto,Kazuhide; Oue,Yasuhiro; Kitamura,Toru; Ota,Osamu, 3-D model providing device.
Binns Bruce W. ; Price Rodney M. ; Palm Charles S. ; Weaver Suzanne E., Apparatus for interactive image correlation for three dimensional image production.
Brown, Daniel M.; Erbach, Peter Scott; Pezzaniti, Joseph Larry; Minamitani, Takahisa, Autostereoscopic display with rotated microlens and method of displaying multidimensional images, especially color images.
Rosakis Ares J. ; Singh Ramen P. ; Kolawa Elizabeth ; Moore ; Jr. Nicholas R., Coherent gradient sensing method and system for measuring surface curvature.
Knighton, Mark S.; Agabra, David S.; McKinley, William D.; Zheng, John Z.; Drobnis, David D.; Logan, J. Douglas; Bahhour, Basel F.; Haynie, Jill E.; Vuong, Kevin H.; Tandon, Amit; Sidney, Kent E.; Diaconescu, Peter L., Digitizer using plural capture methods to image features of 3-D objects.
Jin, Young-gu; Cha, Dae-kil; Lee, Seung-hoon; Park, Yoon-dong, Distance measuring sensor including double transfer gate and three dimensional color image sensor including the distance measuring sensor.
Quarendon Peter,GBX, Image processing system and method for generating data representing a number of points in a three-dimensional space from a plurality of two-dimensional images of the space.
Harada Toshiaki,JPX ; Iwaki Tetsuo,JPX ; Yamada Eiji,JPX ; Okuda Tohru,JPX, Imaging apparatus having a spatial filter and image shifting mechanism controller based on an image mode.
Link Hans-Jorg,DEX, Measuring unit for determining dimensions of test pieces, preferably of hollow bodies, in particular, of bores of workpieces, and method for measuring such dimensions.
Greivenkamp ; Jr. John E. (Rochester NY) Palum Russell J. (Rochester NY) Sullivan Kevin G. (Ft. Myers FL), Method and apparatus for absolute Moire distance measurements using a grating printed on or attached to a surface.
Rushmeier, Holly E.; Bernardini, Fausto, Method and apparatus for acquiring a set of consistent image maps to represent the color of the surface of an object.
Goncharov, Alexander F.; Struzhkin, Viktor V., Optical devices having a wavelength-tunable dispersion assembly that has a volume dispersive diffraction grating.
Michniewicz Mark A. ; Frazer Matthew P., Optical method and system for measuring three-dimensional surface topography of an object having a surface contour.
Berenz, John J.; McIver, George W.; Niesen, Joseph W.; Dunbridge, Barry; Shreve, Gregory A., Optimized human presence detection through elimination of background interference.
Krueger Myron W. (55 Edith Rd. Vernon CT 06066) Hinrichsen Katrin (81 Willington Oaks Storrs CT 06268) Gionfriddo Thomas S. (81 Willington Oaks Storrs CT 06268), Real time perception of and response to the actions of an unencumbered participant/user.
Bass, Leland J.; Quick, Jr., Roy F.; Shah, Ashwin V.; Wickwire, Ralph O., System for electronically displaying portions of several different images on a CRT screen through respective prioritized viewports.
Bieman Leonard H. (Farmington Hills MI) Michniewicz Mark A. (Milford MI), System for optically measuring the surface contour of a part using more fringe techniques.
Albertson, Jacob C.; Arnold, Kenneth C.; Goldman, Steven D.; Paolini, Michael A.; Sessa, Anthony J., Tracking a range of body movement based on 3D captured image streams of a user.
Rakuljic George Anthony (Santa Monica CA) Yariv Amnon (San Marino CA) Leyva Victor (Los Angeles CA) Sayano Koichi (Montebello CA) Tyler Charles E. (Sunnyvale CA), Wavelength stabilized laser sources using feedback from volume holograms.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.