Workshop Format
17 December 2018The topic of evaluation of the incorporation of personalisation within search applications and algorithms and their impact on user engagement and experience of search is currently underexplored within the information retrieval community. This is particularly the case from the perspective of comparative evaluation of interactive and algorithmic elements of personalised search systems, and the representation and exploitation of user models. To reflect this, the workshop will focus on establishing and exploring the principles working towards the outcome of a proposed framework.
The workshop will have the following elements:
- Invited talk. Prof. Ian Ruthven of the University of Strathclyde will deliver an invited keynote presentation.
- Presentations of papers submitted in response to an open call for research and position papers. Papers will be presented as short oral and poster format. The number of oral presentations will be limited to allow for the maximum of time for interactive activities, with other papers being presented as posters.
- Working groups focusing on relevant topics for the evaluation of personalised information retrieval. These topics will be defined on the day, but could include experimental protocols, test collection development, and evaluation metrics.
- Consolidation session. Integration of the activities of the working groups, and proposal of agreed framework or frameworks for the evaluation of personalised information retrieval