Driver

distilbert

Reproduction driver for DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. Source file: scripts/run-reproduction-distilbert.ts ↗.

Driver metadata

Slug
distilbert
Status
active
Protocol match
proxyDriver measures a proxy of the cited metric. Validator C1 auto-downgrades not_reproduced to partial.
Agent version
v0.1.0-distilbert-sst2-microslice
Paper
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
/p/1910.01108arxiv.org ↗
Model
distilbert-base-uncased-finetuned-sst-2-english
huggingface.co/distilbert-base-uncased-finetuned-sst-2-english ↗

Claim citation

This is the exact paper claim the driver compares against before the Verdict Validator allows any public WRONG path.

Location
Table 2 · DistilBERT
Metric
SST-2(accuracy)
Reported value
91.3
PDF page
4
Quoted text
“DistilBERT 77.0 51.3 91.3 85.5 59.9 86.9 56.1 89.2”

Source

Every driver is a TypeScript orchestration script that routes the result through the Verdict Validator. Drivers with runnable public checkpoints also link the hermetic Modal job that loads the model and measures the paper claim.