Click here to view this collection in the new DAP user interface
Addition Relevance Assessments for the TREC Medical Records Track, 2011 and 2012
We are making publicly available a set of additional relevance assessments (qrels) for the TREC Medical Records Track. These are in additional to the officials qrels for this task provided by TREC organisers. The qrels are for the same set TREC query topics but are assessments for an additional 950 documents not previously judged by TREC assessors.... more As with TREC, the assessments were conducted by medical professionals.
Full details about how the assessments were obtained is available in Chapter 7 of:
B. Koopman. Semantic Search as Inference: Applications in Health Informatics. PhD thesis, Queensland University of Technology, Brisbane, Australia, 2014. http://koopman.id.au/papers/KoopmanPhDThesis-SemanticSearchAsInference.pdf
Or for more analysis of this assessment task see also:
B. Koopman and G. Zuccon. Why assessing relevance in medical IR is demanding. In Proceedings of the SIGIR Workshop on Medical Information Retrieval (MedIR), Gold Coast, Australia, July 2014. http://koopman.id.au/papers/medIR2014-relevance_assessment.pdf less
Information Retrieval and Web Search
Creative Commons Attribution 3.0 Unported Licence
Koopman, Bevan (2014): Addition Relevance Assessments for the TREC Medical Records Track, 2011 and 2012. v1. CSIRO. Data Collection.
All Rights (including copyright) CSIRO Australia 2014.
The metadata and files (if any) are available to the public.
1057.1 HIE Research JV
HIE Research JV