A Vision-Based Postproduction Tool for Footage Logging, Analysis and Annotation

We report a new method for logging and annotating video footage directed towards the needs of professional postproduction and archivist end users. SALSA—Semi-Automated Logging with Semantic Annotation—is a hybrid system that uses automated footage analysis for cut detection and camera movement classification, and a stenographic-like keyboard input system for the logging of higher-level semantic information. Output is presented both in standard printed log form, with the addition of mosaic visual representations of shots, and in a fully searchable database. Experimental comparisons of SALSA with conventional hand analysis show a significant increase in the logger’s speed with no reduction in accuracy or semantic detail.