초록 ▼

Immersive video, or television, images of a real-world scene are synthesized, including on demand and/or in real time, as are linked to any of a particular perspective on the scene, or an object or event in the scene. Synthesis is in accordance with user-specified parameters of presentation, includi

Immersive video, or television, images of a real-world scene are synthesized, including on demand and/or in real time, as are linked to any of a particular perspective on the scene, or an object or event in the scene. Synthesis is in accordance with user-specified parameters of presentation, including presentations that are any of panoramic, magnified, stereoscopic, or possessed of motional parallax. The image synthesis is based on computerized video processing--called "hypermosaicing"--of multiple video perspectives on the scene. In hypermosaicing a knowledge database contains information about the scene; for example scene geometry, shapes and behaviors of objects in the scene, and/or internal and/or external camera calibration models. Multiple video cameras each at a different spatial location produce multiple two-dimensional video images of the scene. A viewer/user specifies viewing criterion (ia) at a viewer interface. A computer, typically one or more engineering work station class computers or better, includes in software and/or hardware (i) a video data analyzer for detecting and for tracking scene objects and their locations, (ii) an environmental model builder combining multiple scene images to build a 3D dynamic model recording scene objects and their instant spatial locations, (iii) a viewer criterion interpreter, and (iv) a visualizer for generating from the 3D model in accordance with the viewing criterion one or more selectively synthesized 2D video image(s) of the scene.

대표청구항 ▼

[ What is claim is:] [1.] A method of telepresence, being a video representation of being at real-world scene that is other than the instant scene of the viewer, the method comprising:capturing video of a real-world scene from each of a multiplicity of different spatial perspectives on the scene;pre

[ What is claim is:] [1.] A method of telepresence, being a video representation of being at real-world scene that is other than the instant scene of the viewer, the method comprising:capturing video of a real-world scene from each of a multiplicity of different spatial perspectives on the scene;predetermining a fixed framework of the scene as to the boundaries of the scene and selected fixed points of reference within the scene, the fixed framework and fixed reference points potentially but not necessarily coinciding with landmark objects in the scene if, indeed, any such landmark objects even exist;creating from the captured video in consideration of the predetermined fixed framework a full three-dimensional model of the scene, the three-dimensional model being distinguished in that three-dimension occurrences in the scene are incorporated into the model regardless of that they should not have been pre-identified to the model;producing from the three-dimensional model a video representation on the scene that is in accordance with the desired perspective on the scene of a viewer of the scene, thus immersive telepresence because the viewer can view the scene as if immersed therein, and as if present at the scene, all in accordance with his/her desires;wherein the representation is called immersive telepresence because it appears to the viewer that, since the scene is presented as the viewer desires, the viewer is immersed in the scene;wherein the viewer-desired perspective on the scene, and the video representation in accordance with this viewer-desired perspective, need not be in accordance with any of the captured video.