Creating 3D images of objects by illuminating with infrared patterns
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06T-015/00
G01C-003/14
G01C-003/00
H04N-013/00
출원번호
UP-0108154
(2008-04-23)
등록번호
US-7570805
(2009-08-24)
발명자
/ 주소
Gu, Jin
출원인 / 주소
GestureTek, Inc.
대리인 / 주소
Fish & Richardson P.C.
인용정보
피인용 횟수 :
334인용 특허 :
12
초록▼
According to a general aspect, processing images includes projecting an infra-red pattern onto a three-dimensional object and producing a first image, a second image, and a third image of the three-dimensional object while the pattern is projected on the three-dimensional object. The first image and
According to a general aspect, processing images includes projecting an infra-red pattern onto a three-dimensional object and producing a first image, a second image, and a third image of the three-dimensional object while the pattern is projected on the three-dimensional object. The first image and the second image include the three-dimensional object and the pattern. The first image and the second image are produced by capturing at a first camera and a second camera, respectively, light filtered through an infra-red filter. The third image includes the three-dimensional object but not the pattern. Processing the images also includes establishing a first-pair correspondence between a portion of pixels in the first image and a portion of pixels in the second image. Processing the images further includes constructing, based on the first-pair correspondence and the third image, a two-dimensional image that depicts a three-dimensional construction of the three-dimensional object.
대표청구항▼
What is claimed is: 1. A computer-implemented method comprising: using at least one processor to perform operations comprising: generating first and second images of an object illuminated with a pattern; establishing a first-pair correspondence between initial matched pixels of the first and second
What is claimed is: 1. A computer-implemented method comprising: using at least one processor to perform operations comprising: generating first and second images of an object illuminated with a pattern; establishing a first-pair correspondence between initial matched pixels of the first and second image based on detecting the illuminated pattern in the first and second images; identifying a depth discontinuity associated with the object based on a deformation of the illuminated pattern; controlling a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity; and generating a three-dimensional reconstruction of the object based on the controlled disparity propagation. 2. The method of claim 1, wherein the object is illuminated using infrared light. 3. The method of claim 1, wherein the pattern comprises a stripe. 4. The method of claim 1, wherein identifying the depth discontinuity further comprises identifying a break in the pattern. 5. A device comprising: a camera configured to generate first and second images of an object illuminated with a pattern; and a processor configured to: establish a first-pair correspondence between initial matched pixels of the first and second image based on detecting the illuminated pattern in the first and second images, identify a depth discontinuity associated with the object based on a deformation of the illuminated pattern, control a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity, and generate a three-dimensional reconstruction of the object based on the controlled disparity propagation. 6. A computer-implemented method comprising: using at least one processor to perform operations comprising: receiving first and second pairs of images in a sequence of paired images of an object illuminated with a pattern; and for each of the first and second pairs of images: establishing a first-pair correspondence between initial matched pixels of the paired images based on detecting the illuminated pattern in the paired images, identifying a depth discontinuity associated with the object based on a deformation of the illuminated pattern, controlling a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity, and generating a three-dimensional reconstruction of the object based on the controlled disparity propagation. 7. The method of claim 6, wherein the object is illuminated using infrared light. 8. The method of claim 6, wherein the pattern comprises a stripe. 9. The method of claim 6, wherein, for each of the first and second pairs of images, identifying the depth discontinuity further comprises identifying a break in the pattern. 10. A device comprising: a camera configured to generate first and second pairs of images in a sequence of paired images of an object illuminated with a pattern; and a processor configured, for each of the first and second pairs of images, to: establish a first-pair correspondence between initial matched pixels of the paired images based on detecting the illuminated pattern in the paired images, identify a depth discontinuity associated with the object based on a deformation of the illuminated pattern, control a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity, and generate a three-dimensional reconstruction of the object based on the controlled disparity propagation. 11. A computer-implemented method comprising: using at least one processor to perform operations comprising: receiving first and second images of an object illuminated with a pattern of uncoded stripes; establishing a first-pair correspondence between initial matched pixels of the paired images based on detecting the illuminated pattern in the paired images; identifying a depth discontinuity associated with the object based on a deformation of the illuminated pattern; controlling a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity; and generating a three-dimensional reconstruction of the object based on the controlled disparity propagation. 12. The method of claim 11, wherein the object is illuminated using infrared light. 13. The method of claim 11, wherein identifying the depth discontinuity further comprises identifying a break in the pattern. 14. The method of claim 11, wherein identifying the depth discontinuity further comprises identifying wherein first and second uncoded stripes join each other. 15. A device comprising: a camera configured to generate first and second images of an object illuminated with a pattern of uncoded stripes; and a processor configured to: establish a first-pair correspondence between initial matched pixels of the paired images based on detecting the illuminated pattern in the paired images, identify a depth discontinuity associated with the object based on a deformation of the illuminated pattern, control a disparity propagation of the initial matched pixels in two directions based on the identified depth discontinuity, and generate a three-dimensional reconstruction of the object based on the controlled disparity propagation. 16. A readable computer-readable storage medium, encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to: identify a depth discontinuity associated with an object illuminated with a pattern, based on a deformation of the illuminated pattern; control a disparity propagation in two directions based on the identified depth discontinuity; and generate a three-dimensional reconstruction of the object based on the controlled disparity propagation. 17. The computer-readable storage medium of claim 16, wherein the object is illuminated using infrared light. 18. The computer-readable storage medium of claim 16, wherein the pattern comprises a stripe. 19. A computer-implemented method comprising: using at least one processor to perform operations comprising: identifying a depth discontinuity associated with an object illuminated with a pattern, based on a deformation of the illuminated pattern; controlling a disparity propagation in two directions based on the identified depth discontinuity; and generating a three-dimensional reconstruction of the object based on the controlled disparity propagation. 20. A device comprising a processor configured to: identify a depth discontinuity associated with an object illuminated with a pattern, based on a deformation of the illuminated pattern; control a disparity propagation in two directions based on the identified depth discontinuity; and generate a three-dimensional reconstruction of the object based on the controlled disparity propagation.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (12)
Chon, Jae Choon; Lim, Young Jae; Cho, Seong Ik; Kim, Kyung Ok; Yang, Young Kyu, Apparatus for calculating optical flow and camera motion using correlation matching and system model in moving image.
Herman ; deceased Joshua Randy ; Bergen James Russell ; Peleg Shmuel,ILX ; Paragano Vincent ; Dixon Douglas F. ; Burt Peter J. ; Sawhney Harpreet ; Gendel Gary A. ; Kumar Rakesh ; Brill Michael H., Method and apparatus for mosaic image construction.
Guenter Brian ; Grimm Cindy Marie ; Malvar Henrique Sarmento, Method and system for capturing and representing 3D geometry, color and shading of facial expressions and other animated objects.
Balan, Alexandru; Siddiqui, Matheen; Geiss, Ryan M.; Kipman, Alex Aben-Athar; Williams, Oliver Michael Christian; Shotton, Jamie, Classification of posture states.
Shotton, Jamie Daniel Joseph; Fitzgibbon, Andrew William; Taylor, Jonathan James; Cook, Matthew Darius, Computing pose and/or shape of modifiable entities.
Hulten, Geoffrey J; Mendhro, Umaimah A.; Krum, Kyle J.; Conrad, Michael J.; Remington, Darren B., Controlling a media program based on a media reaction.
Willoughby, Christopher Harley; Evertt, Jeffrey Jesus; Clark, Justin Avram; Hindle, Ben John; Sarrett, Peter Glenn; Deaguero, Joel, Controlling objects in a virtual environment.
Conrad, Michael J.; Hulten, Geoffrey J.; Krum, Kyle J.; Mendhro, Umaimah A.; Remington, Darren B., Determining a future portion of a currently presented media program.
Conrad, Michael J.; Hulten, Geoffrey J; Krum, Kyle J.; Mendhro, Umaimah A.; Remington, Darren B., Determining a future portion of a currently presented media program.
Conrad, Michael J.; Hulten, Geoffrey J.; Krum, Kyle J.; Mendhro, Umaimah A.; Remington, Darren B., Determining audience state or interest using passive sensor data.
Conrad, Michael J.; Hulten, Geoffrey J; Krum, Kyle J.; Mendhro, Umaimah A.; Remington, Darren B., Determining audience state or interest using passive sensor data.
Polzin, R. Stephen; Kipman, Alex A.; Finocchio, Mark J.; Geiss, Ryan Michael; Perez, Kathryn Stone; Tsunoda, Kudo; Bennett, Darren Alexander, Device for identifying and tracking multiple humans over time.
Polzin, R. Stephen; Kipman, Alex A.; Finocchio, Mark J.; Geiss, Ryan Michael; Perez, Kathryn Stone; Tsunoda, Kudo; Bennett, Darren Alexander, Device for identifying and tracking multiple humans over time.
Polzin, R. Stephen; Kipman, Alex A.; Finocchio, Mark J.; Geiss, Ryan Michael; Perez, Kathryn Stone; Tsunoda, Kudo; Bennett, Darren Alexander, Device for identifying and tracking multiple humans over time.
Latta, Stephen; Bennett, Darren; Geisner, Kevin; Markovic, Relja; Tsunoda, Kudo; Snook, Greg; Willoughby, Christopher H.; Sarrett, Peter; Osborn, Daniel Lee, First person shooter control with virtual skeleton.
Evertt, Jeffrey Jesus; Clark, Justin Avram; Middleton, Zachary Tyler; Puls, Matthew J; Mihelich, Mark Thomas; Osborn, Dan; Campbell, Andrew R; Martin, Charles Everett; Hill, David M, Generation of avatar reflecting player appearance.
Kim, David; Hilliges, Otmar D.; Izadi, Shahram; Olivier, Patrick L.; Shotton, Jamie Daniel Joseph; Kohli, Pushmeet; Molyneaux, David G.; Hodges, Stephen E.; Fitzgibbon, Andrew W., Gesture recognition techniques.
Kim, David; Hilliges, Otmar D.; Izadi, Shahram; Olivier, Patrick L.; Shotton, Jamie Daniel Joseph; Kohli, Pushmeet; Molyneaux, David G.; Hodges, Stephen E.; Fitzgibbon, Andrew W., Gesture recognition techniques.
Shotton, Jamie Daniel Joseph; Izadi, Shahram; Hilliges, Otmar; Kim, David; Molyneaux, David Geoffrey; Cook, Matthew Darius; Kohli, Pushmeet; Criminisi, Antonio; Girshick, Ross Brook; Fitzgibbon, Andrew William, Human body pose estimation.
Geisner, Kevin; Markovic, Relja; Latta, Stephen G.; Mihelich, Mark T.; Willoughby, Christopher; Steed, Jonathan T.; Bennett, Darren; Wright, Shawn C.; Coohill, Matt, Interacting with a computer based application.
Markovic, Relia; Snook, Gregory N.; Latta, Stephen; Geisner, Kevin; Lee, Johnny; Lanygridge, Adam Jethro, Method to control perspective for a camera-controlled computer.
Markovic, Relja; Snook, Gregory N.; Latta, Stephen; Geisner, Kevin; Lee, Johnny; Langridge, Adam Jethro, Method to control perspective for a camera-controlled computer.
Markovic, Relja; Snook, Gregory N.; Latta, Stephen; Geisner, Kevin; Lee, Johnny; Langridge, Adam Jethro, Method to control perspective for a camera-controlled computer.
Lee, Johnny Chung; Leyand, Tommer; Stachniak, Simon Piotr; Peeper, Craig; Liu, Shao, Methods and systems for determining and tracking extremities of a target.
Lee, Johnny Chung; Leyvand, Tommer; Stachniak, Szymon Piotr; Peeper, Craig; Liu, Shao, Methods and systems for determining and tracking extremities of a target.
Newcombe, Richard; Izadi, Shahram; Molyneaux, David; Hilliges, Otmar; Kim, David; Shotton, Jamie Daniel Joseph; Kohli, Pushmeet; Fitzgibbon, Andrew; Hodges, Stephen Edward; Butler, David Alexander, Real-time camera tracking using depth maps.
Newcombe, Richard; Izadi, Shahram; Molyneaux, David; Hilliges, Otmar; Kim, David; Shotton, Jamie Daniel Joseph; Kohli, Pushmeet; Fitzgibbon, Andrew; Hodges, Stephen Edward; Butler, David Alexander, Real-time camera tracking using depth maps.
Markovic, Relja; Latta, Stephen G; Geisner, Kevin A; Steed, Jonathan T; Bennett, Darren A; Vance, Amos D, Recognizing user intent in motion capture system.
Bamji, Cyrus; Mehta, Swati, System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed.
Bamji, Cyrus; Mehta, Swati, System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed.
Bamji, Cyrus; Mehta, Swati, System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed.
Kipman, Alex A.; Perez, Kathryn Stone; Finocchio, Mark J.; Geiss, Ryan Michael; Tsunoda, Kudo, Systems and methods for estimating a non-visible or occluded body part.
Mathe, Zsolt; Marais, Charles Claudius; Peeper, Craig; Bertolami, Joe; Geiss, Ryan Michael, Systems and methods for processing an image for target tracking.
Markovic, Relja; Latta, Stephen G.; Geisner, Kevin A.; Hill, David; Bennett, Darren A.; Haley, Jr., David C.; Murphy, Brian S.; Wright, Shawn C., Tracking groups of users in motion capture system.
Santos, Oscar Omar Garza; Haigh, Matthew; Vuchetich, Christopher; Hindle, Ben; Bennett, Darren A., Translating user motion into multiple object responses.
Krum, Kyle James; Conrad, Michael John; Hulten, Geoffrey John; Mendhro, Umaimah A., User interface presenting an animated avatar performing a media reaction.
Pulsipher, Jon D.; Mohadjer, Parham; ElDirghami, Nazeeh Amin; Liu, Shao; Cook, Patrick Orville; Foster, James Chadon; Forbes, Jr., Ronald Omega; Stachniak, Szymon P.; Leyvand, Tommer; Bertolami, Joseph; Janney, Michael Taylor; Huynh, Kien Toan; Marais, Charles Claudius; Perreault, Spencer Dean; Fitzgerald, Robert John; Bisson, Wayne Richard; Peeper, Craig Carroll, Validation analysis of human target.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.