Driver metadata
- Slug
- blip2
- Status
- active
- Protocol match
- proxyDriver measures a proxy of the cited metric. Validator C1 auto-downgrades not_reproduced to partial.
- Agent version
- v0.2.0-blip2-flickr30k-beam5-n100
- Paper
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
- Model
- Salesforce/blip2-opt-2.7b
Claim citation
This is the exact paper claim the driver compares against before the Verdict Validator allows any public WRONG path.
- Location
- Table 3 · BLIP-2 OPT-2.7B
- Metric
- Flickr30k zero-shot BLEU-4(bleu4)
- Reported value
- 43.7
- PDF page
- 7
- Quoted text
- “BLIP-2 OPT-2.7B 43.7”
Source
Every driver is a TypeScript orchestration script that routes the result through the Verdict Validator. Drivers with runnable public checkpoints also link the hermetic Modal job that loads the model and measures the paper claim.
- scripts/run-reproduction-blip2.ts ↗— TS orchestrator (claim citation, DB write, validator wiring)
- modal/reproduce_blip2.py ↗— Python Modal job (HF model load, evaluation harness, measurement)