Data provided by National Institute of Standards and Technology
The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories.
About this Dataset
Updated: 2026-09-19
Metadata Last Updated:
2024-05-09 00:00:00
Date Created:
N/A
Data Provided by:
Dataset Owner:
N/A
| Title | TREC 2023 Tip-of-the-Tongue dataset |
|---|---|
| Description | The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories. |
| Modified | 2024-05-09 00:00:00 |
| Publisher Name | National Institute of Standards and Technology |
| Contact | mailto:[email protected] |
| Keywords | TREC text retrieval conference |
{
"identifier": "ark:\/88434\/mds2-3275",
"accessLevel": "public",
"contactPoint": {
"hasEmail": "mailto:[email protected]",
"fn": "Ian Soboroff"
},
"programCode": [
"006:045"
],
"landingPage": "",
"title": "TREC 2023 Tip-of-the-Tongue dataset",
"description": "The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories.",
"language": [
"en"
],
"distribution": [
{
"accessURL": "https:\/\/trec.nist.gov\/data\/tot\/2023-qrels.txt",
"title": "2023 Tip of the Tongue QRels"
},
{
"accessURL": "https:\/\/trec.nist.gov\/data\/tot\/2023-train.zip",
"title": "2023 Tip-of-the-Tongue training data"
},
{
"accessURL": "https:\/\/trec.nist.gov\/data\/tot\/2023-dev.zip",
"title": "2023 Tip-of-the-Tongue development data"
},
{
"accessURL": "https:\/\/trec.nist.gov\/data\/tot\/2023-test.zip",
"title": "2023 Tip-of-the-Tongue test data"
},
{
"downloadURL": "https:\/\/zenodo.org\/records\/11185090\/files\/corpus.jsonl.zip?download=1",
"format": "JSON lines, compressed with zip",
"description": "This corpus is distributed by the track coordinators via Zenodo",
"mediaType": "application\/zip",
"title": "2023 Tip-of-the-Tongue corpus"
}
],
"bureauCode": [
"006:55"
],
"modified": "2024-05-09 00:00:00",
"publisher": {
"@type": "org:Organization",
"name": "National Institute of Standards and Technology"
},
"theme": [
"Information Technology:Data and informatics"
],
"keyword": [
"TREC text retrieval conference"
]
}
