Subjective Evaluation of Media Consumer Vulnerability to Fake Audiovisual Content

Facilitation of fake face generation in recent years, thanks to advancements in computer graphics and artificial intelligence, raises concerns about malicious use of these techniques for personal or political gains. Media consumers are exposed to hours of audiovisual content daily, while their vulnerability to fake audiovisual content is not yet fully studied and understood. In contrast, many recent automated fake content generation techniques are readily accessible to the public. A first step to address this vulnerability is to study the effectiveness of existing methods in passing human judgment. To this end, we examined the performance of 30 participants in the detection of 48 real and fake videos. The fake videos were sourced from six different methods of generation and were collected from a public video sharing website
¹
, ranging from prosthetic makeup to Deepfakes. Our results show that the participants failed to detect two different types of fake videos. However, participants' detection performance improves when they know of the displayed individual or when a biometric reference video (introducing the individual and its behavior) is available to them during the test.