Development Environment for a Multimodal Interactive System Based on Ontological Knowledge

The aim of the present research is to develop MrailsBuilder, a multimodal interactive system development environment, based on ontological knowledge. MrailsBuilder supports the process of data modeling on MrailsScript by visualizing the structure of ontology. MrailsScript automatically generates a set of prototype codes for a multimodal interactive system based on an MVC model. In addition, MrailsBuilder automatically generates background knowledge of a multimodal interactive system by issuing SPARQL queries from MrailsScript and collecting contents from Linked Open Data. We examined the functionality of MrailsBuilder by developing a typical retrieval system for a multimedia archive.