BookMate: Leveraging Deep Learning to Empower Caregivers of People with ASD in Generation of Social Stories

People with Autism Spectrum Disorder (ASD) have difficulties in social communication and interaction. Their caregivers help them in overcoming these challenges. Social stories are tools largely adopted to improve the interaction and communication capabilities of people with ASD. The creation of a social story is not an easy task. Several guidelines have been defined to build them. In this paper, we propose an interactive mobile application aimed at empowering caregivers of people with ASD in generating social stories. The application integrates AI processing and AI-based audio transcription for story generation, effective audio data extraction, and data processing. The stories are presented in a slide-show format to the learner in different modalities according to the learner's capabilities. A preliminary usability study of the application has been performed and the first results are encouraging.