Actions
  • shareshare
  • link
  • cite
  • add
add
Publication . Conference object . 2012

DCU@TRECMed 2012: Using ad-hoc baselines for domain-specific retrieval

Leveling, Johannes; Goeuriot, Lorraine; Kelly, Liadh; Jones, Gareth J.F.;
Open Access   English  
Published: 09 Nov 2012
Country: Ireland
Abstract
This paper describes the first participation of DCU in the TREC Medical Records Track (TRECMed). We performed some initial experiments on the 2011 TRECMed data based on the BM25 retrieval model. Surprisingly, we found that the standard BM25 model with default parameters, performs comparable to the best automatic runs submitted to TRECMed 2011 and would have resulted in rank four out of 29 participating groups. We expected that some form of domain adaptation would increase performance. However, results on the 2011 data proved otherwise: concept-based query expansion decreased performance, and filtering and reranking by term proximity also decreased performance slightly. We submitted four runs based on the BM25 retrieval model to TRECMed 2012 using standard BM25, standard query expansion, result filtering, and concept-based query expansion. Official results for 2012 confirm that domain-specific knowledge does not increase performance compared to the BM25 baseline as applied by us.
Subjects

Information retrieval

17 references, page 1 of 2

1. King, B., Wang, L., Provalov, I., Zhou, J.: Cengage Learning at TREC 2011 medical track. In: TREC 2010, Gaithersburg, Maryland, National Institute of Standards and Technology (NIST) (2011)

2. Goodwin, T., Rink, B., Roberts, K., Harabagiu, S.M.: Cohort shepherd: discovering cohort traits from hospital visits. In: TREC 2010, Gaithersburg, Maryland, National Institute of Standards and Technology (NIST) (2011)

3. Schuemie, M., Trieschnigg, D., Meij, E.: DutchHatTrick: Semantic query modeling, ConText, session detection, and match score maximization. In: TREC 2010, Gaithersburg, Maryland, National Institute of Standards and Technology (NIST) (2011)

4. Demner-Fushman, D., Abhyankar, S., Jimeno-Yepes, A., Loane, R., Rance, B., Lang, F., Ide, N., Apostolova, E., Aronson, A.R.: A knowledge-based approach to medical records retrieval. In: TREC 2010, Gaithersburg, Maryland, National Institute of Standards and Technology (NIST) (2011)

5. Gurulingappa, H., Muller, B., Hofmann-Apitius, M., Fluck, J.: A semantic platform for information retrieval from e-health records. In: TREC 2010, Gaithersburg, Maryland, National Institute of Standards and Technology (NIST) (2011)

6. Lupu, M., Piroi, F., Huang, X., Zhu, J., Tait, J.: Overview of the TREC 2009 Chemical IR Track. In Voorhees, E.M., Buckland, L.P., eds.: Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009. Volume Special Publication 500-278., NIST (2009)

7. Fujii, A., Iwayama, M., Kando, N.: Overview of the patent retrieval task at the NTCIR-6 workshop. In: Proceedings of NTCIR-6 Workshop Meeting. (2007) 359{ 365 [OpenAIRE]

8. Santos, D., Cardoso, N., Carvalho, P., Dornescu, I., Hartrumpf, S., Leveling, J., Skalban, Y.: GikiP at GeoCLEF 2008: Joining GIR and QA forces for querying Wikipedia. In: Evaluating Systems for Multilingual and Multimodal Information Access, 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers. Volume 5706 of LNCS., Springer (2009) 894{905

9. Kluck, M., Stempfhuber, M.: Domain-speci c track CLEF 2005: Overview of results and approaches, remarks on the assessment analysis. In: Accessing Multilingual Information Repositories, 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005, Vienna, Austria, 21-23 September, 2005, Revised Selected Papers. Volume 4022 of LNCS., Springer (2006) 212{221

10. Petras, V., Baerisch, S., Stempfhuber, M.: The domain-speci c track at CLEF 2007. In: Advances in Multilingual and Multimodal Information Retrieval, 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, Budapest, Hungary, September 19-21, 2007, Revised Selected Papers. Volume 5152 of LNCS., Springer (2008) 160{173

Funded by
SFI| CSET CNGL: Next Generation Localisation (CNGL)
Project
  • Funder: Science Foundation Ireland (SFI)
  • Project Code: 07/CE/I1142
  • Funding stream: SFI Centre for Science Engineering and Technology (CSET)
,
EC| KHRESMOI
Project
KHRESMOI
Knowledge Helper for Medical and Other Information users
  • Funder: European Commission (EC)
  • Project Code: 257528
  • Funding stream: FP7 | SP1 | ICT
Download from