U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Breadcrumb

  1. Home

Trojan Detection Software Challenge - Round 8 Holdout Dataset

This is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.

About this Dataset

Updated: 2022-07-29
Metadata Last Updated: 2021-08-09
Date Created: N/A
Views:
Data Provided by:
National Institute of Standards and Technology
Dataset Owner: N/A

Access this data

Contact dataset owner Landing Page URL
Download URL
Table representation of structured data
Title Trojan Detection Software Challenge - Round 8 Holdout Dataset
Description This is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.
Modified N/A
Publisher Name National Institute of Standards and Technology
Contact mailto:michael.majurski@nist.gov
Keywords Trojan Detection , Artificial Intelligence , AI , Machine Learning , Adversarial Machine Learning
{
    "identifier": "ark:\/88434\/mds2-2538",
    "accessLevel": "public",
    "contactPoint": {
        "hasEmail": "mailto:michael.majurski@nist.gov",
        "fn": "Michael Paul Majurski"
    },
    "programCode": [
        "006:045"
    ],
    "@type": "dcat:Dataset",
    "landingPage": "https:\/\/data.nist.gov\/od\/id\/mds2-2538",
    "description": "This is the training data used to construct and evaluate trojan detection software solutions. This data, generated at NIST, consists of natural language processing (NLP) AIs trained to perform extractive question answering on English text. A known percentage of these trained AI models have been poisoned with a known trigger which induces incorrect behavior. This data will be used to develop software solutions for detecting which trained AI models have been poisoned via embedded triggers. This dataset consists of 360 QA AI models using a small set of model architectures. Half (50%) of the models have been poisoned with an embedded trigger which causes misclassification of the input when the trigger is present.",
    "language": [
        "en"
    ],
    "title": "Trojan Detection Software Challenge - Round 8 Holdout Dataset",
    "distribution": [
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000000x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000000x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000001x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000001x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000002x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000002x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000003x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000003x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000004x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000004x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000005x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000005x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000006x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000006x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000007x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000007x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000008x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000008x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000009x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000009x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000010x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000010x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000011x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000011x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000012x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000012x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000013x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000013x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000014x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000014x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000015x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000015x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000016x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000016x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000017x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000017x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000018x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000018x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000019x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000019x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000020x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000020x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000021x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000021x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000022x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000022x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000023x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000023x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000024x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000024x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000025x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000025x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000026x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000026x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000027x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000027x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000028x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000028x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000029x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000029x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000030x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000030x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000031x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000031x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000032x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000032x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000033x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000033x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000034x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000034x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000035x.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/models\/id-0000035x.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/DATA_LICENSE.txt",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/DATA_LICENSE.txt.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/METADATA.csv",
            "mediaType": "text\/csv"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/METADATA.csv.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/METADATA_DICTIONARY.csv",
            "mediaType": "text\/csv"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/METADATA_DICTIONARY.csv.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/README.txt",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/README.txt.sha256",
            "mediaType": "text\/plain"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/tokenizers.tar.gz",
            "mediaType": "application\/gzip"
        },
        {
            "downloadURL": "https:\/\/data.nist.gov\/od\/ds\/ark:\/88434\/mds2-2538\/round8-holdout-dataset\/tokenizers.tar.gz.sha256",
            "mediaType": "text\/plain"
        },
        {
            "accessURL": "https:\/\/doi.org\/10.18434\/mds2-2538",
            "title": "DOI Access for Trojan Detection Software Challenge - Round 8 Holdout Dataset"
        }
    ],
    "license": "https:\/\/www.nist.gov\/open\/license",
    "bureauCode": [
        "006:55"
    ],
    "modified": "2021-08-09 00:00:00",
    "publisher": {
        "@type": "org:Organization",
        "name": "National Institute of Standards and Technology"
    },
    "theme": [
        "Information Technology:Software research",
        "Information Technology:Cybersecurity"
    ],
    "issued": "2022-01-26",
    "keyword": [
        "Trojan Detection",
        "Artificial Intelligence",
        "AI",
        "Machine Learning",
        "Adversarial Machine Learning"
    ]
}

Was this page helpful?