I. Introduction
In recent years, more and more television receivers have been mounted in cars. This is a result of the remarkably improved terrestrial reception quality and a consequence of more displays finding their way into vehicles. To support the development and production process of mobile television receivers, an automated and objective assessment of reception quality is desirable. Due to the fact that internal parameters of the receiver, like bit error rate or parameters of the video bitstream, often cannot be accessed, receiver evaluation has to be based upon an automatic assessment of its video data. In this work, a test bench will be described that allows to apply different RF scenarios on television receivers in the laboratory and to evaluate the resulting video quality through algorithms. Thus, the quality of the high frequency input stage, the digital demodulator and the channel estimator can be rated, as well as algorithms like antenna diversity or methods of video post-processing (concealment). Afterwards, the task of an automated video quality measurement is discussed. We evaluate several promising quality metrics from literature and use them to benchmark mobile television receivers. In doing so, we compare the suitability and performance of several full-reference metrics and one no-reference metric.