Exploration of User Experience in Mixed Reality for Product Virtual Interaction and Display

In the post-pandemic era, the strong impact affected the user experience and interaction of products. Web-based online stores also lack intuitive product designs, leading to frequent cognitive disputes. Therefore, a new user experience and interactive approach are continuously researched and discussed. Virtual Reality (VR) and Augmented Reality (AR) provide a Mixed Reality (MR) user experience, which has been influencing business models in the industry since 2020. Additionally, with the emergence of the metaverse at the end of 2021, MR has been recognized as a crucial technology with enormous potential for future demands. However, while many innovative applications of MR have achieved considerable success, they still only focus on entertainment-related experiences and have yet to fully explore the comprehensive range of applications and innovative directions for MR. In such circumstances, we investigated the requirements for user experiences and spatial displays in integrating MR into product experiences. We proposed a novel model that transitions from physical to virtual realms to effectively address the aforementioned challenges. The initial phase involved analyzing the prevailing issues and challenges encountered by users in the product and spatial experience services offered by physical stores and web-based online platforms. Subsequently, the results revealed specific needs were met with the MR technology and alleviated associated pain points. The outcomes of the proposed model provide a reference for future studies to research immersive service experiences within real-world settings with MR devices, thereby removing limitations in space and time.