Generation of depth data based on spatial light pattern
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06T-015/00
G01B-011/25
출원번호
US-0122912
(2010-10-05)
등록번호
US-9030466
(2015-05-12)
국제출원번호
PCT/JP2010/005965
(2010-10-05)
§371/§102 date
20110406
(20110406)
국제공개번호
WO2012/046270
(2012-04-12)
발명자
/ 주소
Uehira, Kazutake
Suzuki, Masahiro
출원인 / 주소
Empire Technology Development LLC
대리인 / 주소
Dorsey & Whitney LLP
인용정보
피인용 횟수 :
1인용 특허 :
11
초록▼
Technologies are generally described for generating depth data based on a spatial light pattern. In some examples, a method of generating depth data includes obtaining an image of one or more objects on which a spatial light pattern is projected, wherein blurring of the spatial light pattern in the
Technologies are generally described for generating depth data based on a spatial light pattern. In some examples, a method of generating depth data includes obtaining an image of one or more objects on which a spatial light pattern is projected, wherein blurring of the spatial light pattern in the image monotonously increases or decreases in a depth direction, calculating a value of a spatial frequency component of the image in a local image area around a pixel of interest, and determining depth data corresponding to the calculated value of the spatial frequency component by utilizing a preset relationship between depths and values of the spatial frequency component.
대표청구항▼
1. A method to generate a stereoscopic image from a single two-dimensional image based on depth data, comprising: calculating a value of a spatial frequency component of image data in a local image area around a pixel of interest from the single two-dimensional image, wherein the image data is repre
1. A method to generate a stereoscopic image from a single two-dimensional image based on depth data, comprising: calculating a value of a spatial frequency component of image data in a local image area around a pixel of interest from the single two-dimensional image, wherein the image data is representative of one or more objects on which a spatial light pattern is projected and blurring of the spatial light pattern in the image data increases in a first depth direction and decreases in a second depth direction, the value of the spatial frequency component being based on the increase or decrease of the blurring;determining depth data corresponding to the calculated value of the spatial frequency component from the single two-dimensional image by utilizing a preset relationship between depths and values of the spatial frequency component, the values corresponding to the increase or decrease of the blurring; andgenerating the stereoscopic image from the determined depth data corresponding to the calculated value of the spatial frequency component from the single two-dimensional image. 2. The method of claim 1, further comprising detecting a spatial frequency at which a spatial frequency spectrum of the single two-dimensional image has a maximum value in a frequency range above a threshold frequency, wherein the calculated value of the spatial frequency component is a value of a spatial frequency component at the detected spatial frequency, and wherein the spatial light pattern in the image data is at least periodic at a spatial frequency above the threshold frequency. 3. The method of claim 1, wherein the spatial frequency at which the spatial light pattern in the single two-dimensional image is periodic is a higher spatial frequency than spatial frequencies that are perceivable to human vision when the image data is viewed. 4. The method of claim 1, wherein the local image area is a rectangular area, and the calculating a value of a spatial frequency component comprises calculating spatial frequency components by applying orthogonal transformation to the rectangular area. 5. The method of claim 1, further comprising correcting the calculated value of the spatial frequency component for a reflectance of an object appearing in the local image area of the single two-dimensional image. 6. The method of claim 5, wherein the correcting the calculated value comprises dividing the calculated value by an average luminance of the single two-dimensional image in the local image area. 7. The method of claim 1, further comprising: calculating the preset relationship between depths and values of the spatial frequency component based on first data and second data, wherein the first data is indicative of a first relationship between position in the depth direction and blurring of the spatial light pattern caused by a projection system for projecting the spatial light pattern and the second data is indicative of a second relationship between position in the depth direction and blurring of the spatial light pattern caused by an imaging system for capturing the single two-dimensional image. 8. The method of claim 7, wherein the second data is determined by calculating the blurring of the spatial light pattern caused by the imaging system with respect to different positions in the depth direction based on data indicative of a focus position of the imaging system in the depth direction and a lens aperture size of the imaging system. 9. The method of claim 7, wherein the first data is determined by: projecting the spatial light pattern from the projection system to a flat, monotonous surface;capturing—the single two-dimensional image of the spatial light pattern projected on the surface by use of the imaging system focusing on the surface; andperforming the projecting the spatial light pattern and the capturing the single two-dimensional image of the spatial light patter with respect to flat, monotonous surfaces placed at different positions in the depth direction. 10. An apparatus to generate a stereoscopic image from a single two-dimensional image based on depth data, comprising: a frequency component calculating unit configured to calculate a value of a spatial frequency component of image data in a local image area around a pixel of interest from the single two-dimensional image, wherein the image data is representative of one or more objects on which a spatial light pattern is projected and blurring of the spatial light pattern in the image data increases in a first depth direction and decreases in a second depth direction, the value being based on the increase or decrease of the blurring;a depth map generating unit configured to determine depth data corresponding to the calculated value of the spatial frequency component from the single two-dimensional image by utilizing a preset relationship between depths and values of the spatial frequency component, the values corresponding to the increase or decrease of the blurring; anda stereoscopic image generating unit configured to generate the stereoscopic image from the determined depth data corresponding to the calculated value of the spatial frequency component from the single two-dimensional image. 11. The apparatus of claim 10, further comprising a frequency detecting unit configured to detect a spatial frequency at which a spatial frequency spectrum of the single two-dimensional image has a maximum value in a frequency range above a threshold frequency, wherein the calculated value of the spatial frequency component is a value of a spatial frequency component at the detected spatial frequency, and wherein the spatial light pattern in the image data is at least periodic at a spatial frequency above the threshold frequency. 12. The apparatus of claim 10, wherein the spatial frequency at which the spatial light pattern in the image is periodic is a higher spatial frequency than spatial frequencies that are perceivable to human vision when the single two-dimensional image is viewed. 13. The apparatus of claim 10, wherein the frequency component calculating unit is configured to calculate spatial frequency components by applying orthogonal transformation to a rectangular area that is the local image area. 14. The apparatus of claim 10, further comprising a reflectance correcting unit configured to correct the calculated value of the spatial frequency component for a reflectance of an object appearing in the local image area of the single two-dimensional image. 15. The apparatus of claim 14, wherein the reflectance correcting unit is configured to divide the calculated value by an average luminance of the single two-dimensional image in the local image area. 16. The apparatus of claim 10, wherein the depth map generating unit comprises: a relationship calculating unit configured to calculate the preset relationship between depths and values of the spatial frequency component based on first data and second data, wherein the first data is indicative of a first relationship between position in the depth direction and blurring of the spatial light pattern caused by a projection system for projecting the spatial light pattern and the second data is indicative of a second relationship between position in the depth direction and blurring of the spatial light pattern caused by an imaging system for capturing the single two-dimensional image. 17. The apparatus of claim 16, wherein the blurring data obtaining unit is configured to calculate the blurring of the spatial light pattern caused by the imaging system with respect to different positions in the depth direction based on a focus position of the imaging system and a lens aperture size of the imaging system. 18. A system to generate a stereoscopic image from a single two-dimensional image based on depth data, comprising: a projection unit configured to project a spatial light pattern; andan imaging unit configured to capture the single two-dimensional image of one or more objects on which the spatial light pattern is projected, wherein blurring of the spatial light pattern in the single two-dimensional image monotonously increases or decreases in a depth direction such that depth data corresponding to a calculated value of a spatial frequency component of the single two-dimensional image in a local image area around a pixel of interest can be determined by utilizing a preset relationship between depths and values of the spatial frequency component, the spatial frequency component being based on the increase or decrease of the blurring and the values of the spatial frequency component corresponding to the increase or decrease of the blurring, wherein the imaging unit is further configured to generate the stereoscopic image from the depth data corresponding to the calculated value of the spatial frequency component from the single two-dimensional image. 19. The system of claim 18, wherein the spatial light pattern comprises a checkerboard pattern in which a size of each square area of the checkerboard pattern is at least twice as large as a pixel size in an x direction and in a y direction.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (11)
Nayar Shree ; Noguchi Minori,JPX ; Wantanabe Masahiro,JPX, Apparatus and methods for determining the three-dimensional shape of an object using active illumination and relative blurring in two-images due to defocus.
Hassebrook,Laurence G.; Lau,Daniel L.; Guan,Chun, System and technique for retrieving depth information about a surface by projecting a composite image of modulated light patterns.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.