Instance search retrospective with focus on TRECVID

Author(s):
Awad, G.; Kraaij, W. (0000-0001-7797-619X); Over, P.; Satoh, S.
Published
2017
Publication type
Article / Letter to editor

Abstract

This paper presents an overview of the Video instance search benchmark which was run over a period of 6 years (2010–2015) as part of the TREC Video Retrieval workshop series. The main contributions of the paper include (i) an examination of the evolving design of the evaluation framework and its components (system tasks, data, measures); (ii) an analysis of the influence of topic characteristics (such as rigid/non-rigid, planar/non-planar, stationary/mobile on performance; (iii) a high-level overview of results and best-performing approaches. The instance search benchmark worked with a variety of large collections of data including Sound & Vision, Flickr, BBC Rushes for the first three pilot years and with the small world of the BBC EastEnders series for the last 3 years.

Date issued
2017-02-22
Language
English
Is part of
International Journal of Multimedia Information Retrieval (2017), Vol. 6, no. 1, p. 1-29
hdl
1887/69174
doi
10.1007/s13735-017-0121-3