초록 ▼

A method for integrated audio-visual localizing and tracking of at least one object. The method includes the steps of capturing and transmitting an image of a video scene using a camera at an instant of time, identifying an object contained in the image having a preselected visual feature, and estim

A method for integrated audio-visual localizing and tracking of at least one object. The method includes the steps of capturing and transmitting an image of a video scene using a camera at an instant of time, identifying an object contained in the image having a preselected visual feature, and estimating a location of the object by determining an angular orientation relative to the image plane of the camera of an imaginary line extending from an optical center of the camera to a point on the image plane of the camera representing a portion of the object. The method further includes the steps of converting acoustic waves from an audio source into audio signals using at least two microphones at substantially the same time, identifying the audio source by determining a locus of points representing an estimate of the location of the audio source on the basis of the audio signals. An improved estimate of the location of the object is computed by determining the location of a region of intersection between the imaginary line and the locus.

대표청구항 ▼

[ What is claimed is:] [1.] An integrated audio-visual method for localizing and tracking at least one object, comprising the steps of:capturing and transmitting an image of a video scene using a camera at an instant of time;identifying an object contained in said image having a preselected visual f

[ What is claimed is:] [1.] An integrated audio-visual method for localizing and tracking at least one object, comprising the steps of:capturing and transmitting an image of a video scene using a camera at an instant of time;identifying an object contained in said image having a preselected visual feature;estimating a location of the object by determining an angular orientation relative to the image plane of the camera of an imaginary line extending from an optical center of the camera to a point on the image plane of the camera representing a portion of the object;converting acoustic waves from an audio source into audio signals using at least two microphones at substantially said instant of time;identifying the audio source by determining on the basis of the audio signals a locus of points representing an estimate of the location of the audio source; andcomputing the location of a region of intersection between the imaginary line and the locus, the intersection region being an improved estimate of the location of the object.