Gurrin, C., Schoeffmann, K., Joho, H. et al. (5 more authors) (2018) A test collection for interactive lifelog retrieval. In: Kompatsiaris, I., Huet, B., Mezaris, M., Gurrin, C., Cheng, W.-H. and Vrochidis, S., (eds.) MultiMedia Modeling. 25th International Conference on MultiMedia Modeling, 08-11 Jan 2019, Thessaloniki, Greece. Lecture Notes in Computer Science, 11295 . Springer Verlag , pp. 312-324. ISBN 978-3-030-05709-1
Abstract
There is a long history of repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists that has been designed to support interactive lifelog retrieval. In this paper we introduce the LSC2018 collection, that is designed to evaluate the performance of interactive retrieval systems. We describe the features of the dataset and we report on the outcome of the first Lifelog Search Challenge (LSC), which used the dataset in an interactive competition at ACM ICMR 2018.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | © 2018 Springer Verlag. This is an author produced version of a paper subsequently published in MultiMedia Modeling (LNCS 11295). Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Interactive retrieval; lifelogging; comparative evaluation; test collection; multimodal dataset |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 17 Oct 2018 09:36 |
Last Modified: | 20 Dec 2018 15:09 |
Published Version: | https://doi.org/10.1007/978-3-030-05710-7_26 |
Status: | Published |
Publisher: | Springer Verlag |
Series Name: | Lecture Notes in Computer Science |
Refereed: | Yes |
Identification Number: | 10.1007/978-3-030-05710-7_26 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:137229 |