TREC 1999 Adhoc Dataset
The ad hoc retrieval task investigates the performance of systems that search a static set of documents using new questions (called topics in TREC). This task is similar to how a researcher might use a library - the collection is known but the questions likely to be asked are not known. NIST provides the participants approximately 2 gigabytes worth of documents and a set of 50 natural language topic statements. The participants produce a set of queries from the topic statements and run those queries against the documents. The output from this run is the official test result for the ad hoc task. Participants return the best 1000 documents retrieved for each topic to NIST for evaluation. The dataset comprises the documents, the topics, and the annotations of relevant documents.
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[
"006:55"
]
|
| contactPoint |
{
"fn": "Ian Soboroff",
"hasEmail": "mailto:ian.soboroff@nist.gov"
}
|
| description | The ad hoc retrieval task investigates the performance of systems that search a static set of documents using new questions (called topics in TREC). This task is similar to how a researcher might use a library - the collection is known but the questions likely to be asked are not known. NIST provides the participants approximately 2 gigabytes worth of documents and a set of 50 natural language topic statements. The participants produce a set of queries from the topic statements and run those queries against the documents. The output from this run is the official test result for the ad hoc task. Participants return the best 1000 documents retrieved for each topic to NIST for evaluation. The dataset comprises the documents, the topics, and the annotations of relevant documents. |
| distribution |
[
{
"title": "TREC 1999 ADHOC CORPUS",
"accessURL": "https://trec.nist.gov/data/cd45/index.html"
},
{
"title": "TREC 1999 Adhoc document corpus",
"accessURL": "https://trec.nist.gov/data/cd45/index.html"
},
{
"title": "TREC 1999 ADHOC QRELS",
"accessURL": "https://trec.nist.gov/data/qrels_eng/qrels.trec8.adhoc.parts1-5.tar.gz"
},
{
"title": "TREC 1999 Adhoc relevance judgments ("qrels")",
"accessURL": "https://trec.nist.gov/data/qrels_eng/qrels.trec8.adhoc.parts1-5.tar.gz"
},
{
"title": "TREC 1999 Adhoc Topics",
"format": "SGML",
"accessURL": "https://trec.nist.gov/data/topics_eng/topics.401-450.gz"
},
{
"title": "TREC 1999 ADHOC TOPICS",
"accessURL": "https://trec.nist.gov/data/topics_eng/topics.401-450.gz"
}
]
|
| identifier | ark:/88434/mds2-3620 |
| issued | 2025-01-14 |
| keyword |
[
"TREC text retrieval conference"
]
|
| landingPage | https://data.nist.gov/od/id/mds2-3620 |
| language |
[
"en"
]
|
| license | https://www.nist.gov/open/license |
| modified | 2024-10-31 00:00:00 |
| programCode |
[
"006:045"
]
|
| publisher |
{
"name": "National Institute of Standards and Technology",
"@type": "org:Organization"
}
|
| references |
[
"https://trec.nist.gov/pubs/trec8/t8_proceedings.html"
]
|
| theme |
[
"Information Technology:Data and informatics"
]
|
| title | TREC 1999 Adhoc Dataset |
