Benchmark & method · adaptive driver alerting · CoRL 2026
VLAlertObserve Before You Alert: Adaptive Driver Alerting with Vision–Language Models
A unified per-tick benchmark for deciding when a driving system should stay SILENT, OBSERVE, or ALERT — and a vision–language policy in which the OBSERVE action acts as an internal evidence-gathering decision that delays uncertain warnings.
At each one-second tick a model sees the last eight frames and predicts the appropriate alert action. VLAlert-Bench joins six driving-event sources into one task — 13,534 videos and 192,892 labelled ticks across five splits — and the VLAlert policy, built on Qwen3-VL-4B, is scored on it and on held-out ADAS-TO-Critic takeover clips.
CoRL 2026 · accepted · arXiv 2609.08130CoRL 2026 Travel AwardCC BY 4.0 · gated, manual approval
Yuhang Wang1·Lingyao Li2·Hao Zhou1
1University of South Florida · MOTIF-Lab 2University of Arizona