Data provided by National Institute of Standards and Technology
Round 7 Holdout DatasetThis is the holdout data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform named entity recognition (NER) on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 384 named entity recognition AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.
About this Dataset
Updated: 2024-02-22
Metadata Last Updated:
2021-05-07 00:00:00
Date Created:
N/A
Views:
Data Provided by:
Dataset Owner:
N/A
| Title | Trojan Detection Software Challenge - nlp-named-entity-recognition-may2021-holdout |
|---|---|
| Description | Round 7 Holdout DatasetThis is the holdout data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform named entity recognition (NER) on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 384 named entity recognition AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present. |
| Modified | 2021-05-07 00:00:00 |
| Publisher Name | National Institute of Standards and Technology |
| Contact | mailto:[email protected] |
| Keywords | Trojan Detection; Artificial Intelligence; AI; Machine Learning; Adversarial Machine Learning; |
{
"identifier": "ark:\/88434\/mds2-2459",
"accessLevel": "public",
"contactPoint": {
"hasEmail": "mailto:[email protected]",
"fn": "Michael Paul Majurski"
},
"programCode": [
"006:045"
],
"landingPage": "https:\/\/data.nist.gov\/od\/id\/mds2-2459",
"title": "Trojan Detection Software Challenge - nlp-named-entity-recognition-may2021-holdout",
"description": "Round 7 Holdout DatasetThis is the holdout data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform named entity recognition (NER) on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 384 named entity recognition AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.",
"language": [
"en"
],
"distribution": [
{
"accessURL": "https:\/\/drive.google.com\/drive\/folders\/1pJcBEKzpNQA6LFp86p1TkA3S-XmmtVEP?usp=drive_link",
"title": "nlp-named-entity-recognition-may2021-holdout"
}
],
"bureauCode": [
"006:55"
],
"modified": "2021-05-07 00:00:00",
"publisher": {
"@type": "org:Organization",
"name": "National Institute of Standards and Technology"
},
"theme": [
"Information Technology:Software research",
"Information Technology:Cybersecurity"
],
"keyword": [
"Trojan Detection; Artificial Intelligence; AI; Machine Learning; Adversarial Machine Learning;"
]
}
