RAD-LAD: Rule and Language Grounded Autonomous Driving in Real-Time

View PDF HTML (experimental)

Abstract:We present LAD, a real-time language--action planner with an interruptible architecture that produces a motion plan in a single forward pass (~20 Hz) or generates textual reasoning alongside a motion plan (~10 Hz). LAD is fast enough for real-time closed-loop deployment, achieving ~3x lower latency than prior driving language models while setting a new learning-based state of the art on nuPlan Test14-Hard and InterPlan. We also introduce RAD, a rule-based planner designed to address structural limitations of PDM-Closed. RAD achieves state-of-the-art performance among rule-based planners on nuPlan Test14-Hard and InterPlan. Finally, we show that combining RAD and LAD enables hybrid planning that captures the strengths of both approaches. This hybrid system demonstrates that rules and learning provide complementary capabilities: rules support reliable maneuvering, while language enables adaptive and explainable decision-making.

Subjects:

Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

Cite as: arXiv:2603.28522 [cs.RO]

(or arXiv:2603.28522v2 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2603.28522

arXiv-issued DOI via DataCite

Submission history

From: Anurag Ghosh [view email] [v1] Mon, 30 Mar 2026 14:50:37 UTC (3,702 KB) [v2] Tue, 31 Mar 2026 03:25:18 UTC (3,703 KB)