Representation Method for Significant Pauses in a Multimodal Motion Learning System

We are currently developing a multimodal motion learning system designed to help students master the procedures used in traditional arts, as well as traditional crafting techniques. In this paper, we introduce a prototype of a system that is designed to utilize a virtual agent, and investigate a comprehensive timing representation method that pays specific attention to the significant pauses that are sometimes interjected between motions. By acknowledging the existence of such significant pauses, we believe it is possible for learners to improve their motion learning performance.

I. Introduction

In recent years, many of the skills necessary for producing superior traditional Japanese arts have become endangered due to a lack of interest in acquiring the required techniques and procedures on the part of the younger generation. In order to ensure that the cultural heritage embodied in these arts is not lost, we believe that it is important to create a digital library that records the traditional skills required in the creation of traditional products, as well as the procedures used in the performance of traditional arts. However, simply recording such information is insufficient. In order to spread the full knowledge involved in traditional arts, this digital library data should be optimized for use in education. To facilitate this, we have developed a motion learning system framework that uses the contents of a digital library of Japanese traditional arts [1].