Dual-Stage LLM Framework for Scenario-Centric Semantic Interpretation in Driving Assistance
Hey there, little explorer! Imagine your toy car is super smart, like a robot! 🚗💨
Sometimes, this smart toy car tries to understand what's happening around it, like if a ball rolls into the street or a friend is walking.
Scientists are teaching these smart car brains (we call them "LLMs," like super-duper talking robots!) to be extra careful. They want to make sure the car knows when something is a little bit risky or very, very risky.
This paper is like a special game where they test the smart car brains. They show them pictures and tell them stories about driving, then ask, "Is this safe or not?" 🚦
They found that sometimes, even smart robot brains don't always agree on what's risky. So, they're working hard to teach them to be super clear and safe, especially when people are nearby! It's like making sure your toy car always knows to stop for your teddy bear! 🐻🛑
arXiv:2603.27536v1 Announce Type: new Abstract: Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is interpreted and communicated. This paper presents a scenario-centric framework for reproducible auditing of LLM-based risk reasoning in urban driving contexts. Deterministic, temporally bounded scenario windows are constructed from multimodal driving data and evaluated under fixed prompt constraints and a close — Jean Douglas Carvalho, Hugo Taciro Kenji, Ahmad Mohammad Saber, Glaucia Melo, Max Mauro Dias Santos, Deepa Kundur
View PDF HTML (experimental)
Abstract:Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is interpreted and communicated. This paper presents a scenario-centric framework for reproducible auditing of LLM-based risk reasoning in urban driving contexts. Deterministic, temporally bounded scenario windows are constructed from multimodal driving data and evaluated under fixed prompt constraints and a closed numeric risk schema, ensuring structured and comparable outputs across models. Experiments on a curated near-people scenario set compare two text-only models and one multimodal model under identical inputs and prompts. Results reveal systematic inter-model divergence in severity assignment, high-risk escalation, evidence use, and causal attribution. Disagreement extends to the interpretation of vulnerable road user presence, indicating that variability often reflects intrinsic semantic indeterminacy rather than isolated model failure. These findings highlight the importance of scenario-centric auditing and explicit ambiguity management when integrating LLM-based reasoning into safety-aligned driver assistance systems.
Subjects:
Artificial Intelligence (cs.AI)
Cite as: arXiv:2603.27536 [cs.AI]
(or arXiv:2603.27536v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2603.27536
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Jean Carvalho [view email] [v1] Sun, 29 Mar 2026 06:20:08 UTC (4,637 KB)
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
researchpaperarxiv
Looking for Help on Building a Cheap/Budget Dedicated AI System
I’ve been getting into the whole AI field over the course of the year and I’ve strictly said to NEVER use cloud based AI (Or under VERY strict and specific circumstances). For example, i was using Opencode’s cloud servers, but only because it was through their own community maintained infrastructure/servers and also it was about as secure as it gets when it comes to cloud AI. But anything else is a hard NO. I’ve been using my main machine (Specs on user) and so far it’s been pretty good. Depending on the model, I can run 30-40B models at about 25-35 tok/s, which for me is completely usable, anything under or close to 10 tok/s is pretty unusable for me. But anyways, that has been great for me, but I’m slowly running into VRAM and GPU limitations, so I think it’s time to get some dedicated h
China team releases world’s first bamboo drone flight control software – for free
A team of researchers in China has unveiled what they describe as the world’s first open-source flight control system designed specifically for bamboo-frame drones, offering a potential breakthrough in the push for low-cost, eco-friendly unmanned aerial vehicles (UAVs). The system, developed by researchers at Northwestern Polytechnical University’s school of civil aviation, aims to solve a long-standing bottleneck in sustainable drone design: integrating non-traditional materials such as bamboo...
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Research Papers
![Thoughts on AI and Research [pdf]](https://d2xsxph8kpxj0f.cloudfront.net/310419663032563854/konzwo8nGf8Z4uZsMefwMr/default-img-robot-hand-JvPW6jsLFTCtkgtb97Kys5.webp)
Request for arXiv cs.AI Endorsement – Life-Aligned AI Framework
Hi everyone, I’m preparing to submit a paper to arXiv (cs.AI, with cross-lists to q-bio.PE and physics.soc-ph) and am currently awaiting endorsement from a qualified author. Posting here in case anyone in this community can help or knows someone who can. Title: Life-Aligned AI: A Framework for Grounding Artificial Intelligence in the Empirical Conditions of Flourishing Here’s the main idea: Current alignment approaches work backwards — rules imposed in advance by minds that the systems they constrain may eventually exceed. This paper proposes a different starting point: training AI on living systems — the only adaptive framework continuously pressure-tested across four billion years under conditions of genuine consequence — and letting the operating principles emerge from genuine reasoning
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!