Scarlet - Artificial Teaching Assistant

Scarlet an Artificial Teaching Assistant is a personal digital assistant that has been developed with main aim to assist students in their learning process by ensuring fast and efficiently search of documents and learning materials. Scarlet is able to give an adequate response to a specific question based on knowledge gathered by an unique algorithm which enables her to recognize context during file and web page content search. After finding the most appropriate answer Scarlet seeks for student feedback in order to improve future search. The metric proposed is based on the power law which occurs in natural language, that is the Zipfian distribution[1]. It is designed to work for any spoken language although it might work on some better than other depending on the nature of the language, the structure, grammar and semantics. The method uses this metric to derive context from data and then queries the data source looking for the best match. The whole implementation is rounded off by a learning module which gives the system a learning curve based on users (students) scoring how relevant the output is among other parameters.

I. Introduction

It is impossible to ignore the fact that by every second the amount of data available to the end user experiences exponential increases. Managing large amounts of data and its transformation into knowledge has always occupied minds of researchers. In the early days the problem was in providing sufficient space for data storage. Aforementioned problem can be considered as completely solved thanks to the rapid development of the high-capacity hardware (storage) components. However, some very important challenges still remains. Main challenge is to find adequate methods for searching large amounts of data or data lakes. Although, some of the existing algorithms and indexing techniques made the search process considerably fast, they still require a significant effort in order to improve and customize.