Studying the Impact of the Content Selection Method on the Video QoE on Mobile Devices

When conducting video QoE studies participants are usually asked to rate the QoE of prepared test videos. However, participants are given no choice to select content, which they like or in which they are interested. This may cause annoyance or frustration when conducting the QoE study, which eventually might affect the QoE results of the study. The consequent question is whether the content liking has a direct impact on the submitted ratings by the participants and whether the freedom of choosing the video content in QoE studies results in better ratings. To investigate this research question, CroQoE, an existing framework for crowdsourced video testing, is extended and used in a pilot field study. In this work, the results of a QoE study with individual and dynamic content selection are compared to a QoE study with pre-selected contents. Moreover, this work includes a comparison to a previous QoE study for validation. As the previous study was conducted on desktop PCs, the CroQoE study further allows to identify differences in the stalling perception between studies on desktop PCs and mobile devices.