dc.contributor.author | Schuth, Anne | |
dc.contributor.author | Balog, Krisztian | |
dc.contributor.author | Kelly, Liadh | |
dc.date.accessioned | 2016-01-26T12:16:08Z | |
dc.date.accessioned | 2023-01-05T11:49:21Z | |
dc.date.available | 2016-01-26T12:16:08Z | |
dc.date.available | 2023-01-05T11:49:21Z | |
dc.date.issued | 2015 | |
dc.identifier.citation | Schuth, A., Balog, K. & Kelly, L. (2015). Extended Overview of the Living Labs for Information Retrieval Evaluation (LL4IR) CLEF Lab 2015. CEUR Workshop Proceedings 2015, vol. 1391. | en_US |
dc.identifier.issn | 1613-0073 | |
dc.identifier.uri | https://hdl.handle.net/11250/3041198 | |
dc.description.abstract | In this extended overview paper we discuss the first Living Labs for Information Retrieval Evaluation (LL4IR) lab which was held at CLEF 2015. The idea with living labs is to provide a benchmarking platform for researchers to evaluate their ranking systems in a live setting with real users in their natural task environments. LL4IR represents the first attempt to offer such experimental platform to the IR research community in the form of a community challenge. For this first edition of the challenge we focused on two specific use-cases: product search and web search. Ranking systems submitted by participants were experimentally compared using interleaved comparisons to the production system from the corresponding use-case. In this paper we describe how these experiments were performed, what the resulting outcomes are, and provide a detailed analysis of the use-cases and a discussion of ideas and opportunities for future development. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | CEUR-WS | en_US |
dc.title | Extended Overview of the Living Labs for Information Retrieval Evaluation (LL4IR) CLEF Lab 2015 | en_US |
dc.type | Journal article | en_US |
dc.date.updated | 2016-01-26T12:16:07Z | |
dc.description.version | publishedVersion | en_US |
dc.rights.holder | The authors | en_US |
dc.subject.nsi | VDP::Teknologi: 500 | en_US |
dc.identifier.cristin | 1322677 | |