Communicating experiential and spatial qualities of complex political narratives using mixed video-virtual environments

This paper reflects on the process of combining an interactive virtual environment and wall-video projection to create an interactive installation for design activism. The prototype aimed at communicating spatially and experientially narratives of the occupation of Palestine. The design process, informed by interdisciplinary research, experimented with various low-cost technologies and new media to create an immersive experience. The decision was to create a multi-channel installation, which consists of an interactive virtual environment and video projections. The Unity game engine was used to create the virtual environment that served as the main interactive interface. Leap Motion Controller, which is an infrared sensor, was used as the input device for the interaction. Wall projections as the output channels were synchronised to create immersion and build on the spatial experience. The videos projected were edited from the Internet-sourced footage, created mainly by people in Palestine or from different activist organizations. Key experts from different disciplines related to the research were invited to test the prototype. Their interaction and feedback were documented via video and audio recordings and a follow-up questionnaire. The test group critically discussed key points, for example, the use of the virtual environment, the usability of the Leap Motion Controller, the presentation of information and the aesthetics of the interface. The documentation of the process of designing and testing a politically motivated mixed video-virtual environment has produced an important discussion of consideration points and themes. This discussion can serve further development of this particular work and can be used as recommendation models for communicating other contested political narratives especially for misrepresented or under-resourced people. This paper will focus on some of the themes generated by the self-reflection on the design process rather than delve into the discussion of the feedback from the testing and evaluation process due to the limitation of this paper's scope.