| The Evaluation of Question Answering Systems: (2002) | |||||||||||||||||
Abstract | |||||||||||||||||
| The TREC question answering (QA) track was the first large-scale evaluation of open-domain question answering systems. In addition to successfully fostering research on the QA task, the track has also been used to investigate appropriate evaluation methodologies for question answering systems. This paper gives a brief history of the TREC QA track, motivating the decisions made in its implementation and summarizing the results. The lessons learned from the track will be used to evolve new QA evaluations for both the track and the ARDA AQUAINT program. | |||||||||||||||||
Publication details | |||||||||||||||||
| |||||||||||||||||