← Back to Robotics
cs.RO

Making autonomous vehicle perception systems explainable and trustworthy

Till Beemelmanns, Shayan Sharifi, Manas Mehrotra, Ayushman Choudhuri, Lutz Eckstein

May 15, 2026

Deep neural networks power autonomous driving perception but their opacity conflicts with safety requirements and regulatory expectations. This work bridges that gap by building a transformer-based 3D object detector that provides faithful explanations via attention mechanisms, calibrated uncertainty estimates, and improved robustness. The team validated explanation faithfulness through perturbation tests, integrated uncertainty calibration, and applied robustness-enhancing training. The system was deployed in a prototype vehicle with a live interface showing saliency maps and model confidence, demonstrating practical feasibility for trustworthy perception monitoring during operation.
Published as Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment arXiv:2605.16087
Read the original paper →