I. Introduction
A critical technological aspect in the control of autonomous vehicles is forecasting future states of the surrounding environment to facilitate safe navigation through dynamic surroundings. The predicted future trajectories of traffic participants play an important role in detecting potential hazards in advance and are essential for the design of decision-making or planning algorithms [1], [2]. This predictive task relies on utilizing perceived data, such as camera and LiDAR data [3]-[6]. This data is mostly tracked across multiple timestamps, transformed into trajectories, and then integrated into maps to enable accurate predictions [3], [5].