Indexing of Fictional Video Content for Event Detection and SummarisationReport as inadecuate




Indexing of Fictional Video Content for Event Detection and Summarisation - Download this document for free, or read online. Document in PDF available to download.

EURASIP Journal on Image and Video Processing

, 2007:014615

First Online: 03 October 2007Received: 30 September 2006Revised: 22 May 2007Accepted: 02 August 2007

Abstract

This paper presents an approach to movie video indexing that utilises audiovisual analysis to detect important and meaningful temporal video segments, that we term events. We consider three event classes, corresponding to dialogues, action sequences, and montages, where the latter also includes musical sequences. These three event classes are intuitive for a viewer to understand and recognise whilst accounting for over 90% of the content of most movies. To detect events we leverage traditional filmmaking principles and map these to a set of computable low-level audiovisual features. Finite state machines FSMs are used to detect when temporal sequences of specific features occur. A set of heuristics, again inspired by filmmaking conventions, are then applied to the output of multiple FSMs to detect the required events. A movie search system, named MovieBrowser, built upon this approach is also described. The overall approach is evaluated against a ground truth of over twenty-three hours of movie content drawn from various genres and consistently obtains high precision and recall for all event classes. A user experiment designed to evaluate the usefulness of an event-based structure for both searching and browsing movie archives is also described and the results indicate the usefulness of the proposed approach.

Download fulltext PDF



Author: Bart Lehane - NoelE O-Connor - Hyowon Lee - AlanF Smeaton

Source: https://link.springer.com/



DOWNLOAD PDF




Related documents