I. Introduction
Autonomous vehicles (AVs) are poised to revolutionize future transportation systems [1], largely due to advancements in reinforcement learning (RL) that enable these systems to make intelligent decisions in complex environments [2]. While modern RL algorithms can effectively support current AV adoption, new ethical challenges emerge as AVs are increasingly integrated into public roadways. A particularly pressing issue is the behavior of AVs in morally uncertain situations, where predefined rules may not suffice, and the consequences of their actions can have significant ethical implications [3], [4].