Multimodal 3-D tracking and event detection via the particle filter

TitleMultimodal 3-D tracking and event detection via the particle filter
Publication TypeConference Papers
Year of Publication2001
AuthorsZotkin DN, Duraiswami R, Davis LS
Conference NameIEEE Workshop on Detection and Recognition of Events in Video, 2001. Proceedings
Date Published2001///
PublisherIEEE
ISBN Number0-7695-1293-3
Keywordsalgorithms, APPROACH, audio data collection, audio signal processing, Bayesian inference, Bayesian methods, belief networks, CAMERAS, capture, conversation, echo, Educational institutions, Event detection, event occurrence, filtering theory, flying echo locating bat behaviour, Image motion analysis, inference mechanisms, Laboratories, microphone arrays, moving object tracking, moving participants, moving prey, multimodal 3D tracking, multiple cameras, Object detection, particle filter, Particle filters, Particle tracking, Robustness, search, smart video conferencing setup, target tracking, Teleconferencing, tracking filters, turn-taking detection, video data collection, video signal processing
Abstract

Determining the occurrence of an event is fundamental to developing systems that can observe and react to them. Often, this determination is based on collecting video and/or audio data and determining the state or location of a tracked object. We use Bayesian inference and the particle filter for tracking moving objects, using both video data obtained from multiple cameras and audio data obtained using arrays of microphones. The algorithms developed are applied to determining events arising in two fields of application. In the first, the behavior of a flying echo locating bat as it approaches a moving prey is studied, and the events of search, approach and capture are detected. In a second application we describe detection of turn-taking in a conversation between possibly moving participants recorded using a smart video conferencing setup
DOI10.1109/EVENT.2001.938862