Loading [MathJax]/extensions/MathMenu.js
SleepGAN: Towards Personalized Sleep Therapy Music | IEEE Conference Publication | IEEE Xplore

SleepGAN: Towards Personalized Sleep Therapy Music


Abstract:

Sleep deficiency and disorders are one of the most unsolved public health challenges of modern times. Music therapy is a promising approach, offering a cheap and non-inva...Show More

Abstract:

Sleep deficiency and disorders are one of the most unsolved public health challenges of modern times. Music therapy is a promising approach, offering a cheap and non-invasive solution to improve sleep quality. However, the choice of therapeutic sleep music is highly limited for users because such music needs to be specially chosen and made by sleep therapists. It could potentially lead to the inefficiency of music therapy if users get bored after listening to the same set of music repeatedly. In this paper, we take the first step towards generating personalized sleep therapy music. Firstly, through an in-depth feature analysis, we investigate the importance of various musical and acoustic features of therapy music. Grounded on our findings, we design a style transfer framework called SleepGAN which induces therapeutic features into music from different genres. We show that, compared to baselines, the music generated by SleepGAN has a higher similarity to the sleep music designed by experts.
Date of Conference: 23-27 May 2022
Date Added to IEEE Xplore: 27 April 2022
ISBN Information:

ISSN Information:

Conference Location: Singapore, Singapore
References is not available for this document.

1. INTRODUCTION

Sleep is an essential function of the human body and has a direct impact on our physical and mental well-being. Research has shown that sleep disruption and disorders have a strong causal link to major lifestyle diseases such as memory loss, obesity, diabetes, and cancer [1], [2]. Unfortunately, sleep disorders are highly prevalent in our society — studies show that nearly 40% of United Kingdom adults and roughly 50–70 million American adults experience them [3], [4]. Cognitive Behavior Therapy and pharmaceutical sleep aids are two common clinical interventions to alleviate sleep disorders. However, they are expensive and have potentially harmful side-effects [5], which has led to research in designing non-invasive, low-cost interventions to address sleep disorders.

Select All
1.
F. P. Cappuccio, F. M. Taggart, N.-B. Kandala, A. Currie, E. Peile, S. Stranges, et al., "Meta-analysis of short sleep duration and obesity in children and adults", Sleep, vol. 31, no. 5, pp. 619-626, 2008.
2.
F. P. Cappuccio, L. D’Elia, P. Strazzullo and M. A. Miller, "Quantity and quality of sleep and incidence of type 2 diabetes: a systematic review and meta-analysis", Diabetes care, vol. 33, no. 2, pp. 414-420, 2010.
3.
T. Trahan, S. J. Durrant, D. Müllensiefen and V. J. Williamson, "The music that helps people sleep and the reasons they believe it works: A mixed methods analysis of online survey reports", PloS one, vol. 13, no. 11, pp. e0206531, 2018.
4.
"CDC declares sleep disorders a public health epidemic", [online] Available: https://www.sleepdr.com/the-sleep-blog/cdc-declares-sleep-disorders-a-public-health-epidemic/.
5.
L. Degenhardt, S. Darke and P. Dillon, "GHB use among australians: characteristics use patterns and associated harm", Drug and alcohol dependence, vol. 67, no. 1, pp. 89-94, 2002.
6.
D. Fancourt, A. Ockelford and A. Belai, "The psychoneuroim-munological effects of music: A systematic review and a new model", Brain behavior and immunity, vol. 36, 2014.
7.
A. Linnemann, B. Ditzen, J. Strahler, J. M. Doerr and U. M. Nater, "Music listening as a means of stress reduction in daily life", Psychoneuroendocrinology, vol. 60, pp. 82-90, 2015.
8.
U. Nilsson, "Soothing music can increase oxytocin levels during bed rest after open-heart surgery: a randomised control trial", Journal of clinical nursing, vol. 18, no. 15, 2009.
9.
"Bose sleepbuds", [online] Available: https://tinyurl.com/c778kuxs.
10.
E.-T. Chang, H.-L. Lai, P.-W. Chen, Y.-M. Hsieh and L.-H. Lee, "The effects of music on the sleep quality of adults with chronic insomnia using evidence from polysomnographic and self-reported analysis: a randomized control trial", International journal of nursing studies, vol. 49, no. 8, 2012.
11.
A. Yamasato, M. Kondo, S. Hoshino, J. Kikuchi, M. Ikeuchi, K. Yamazaki, et al., "How prescribed music and preferred music influence sleep quality in university students", The Tokai Journal of Experimental and Clinical Medicine, vol. 45, no. 4, 2020.
12.
"The science behind killing a song when you listen to it too much", [online] Available: https://www.independent.co.uk/life-style/killing-song-science-magic-lost-listen-too-much-sound-goodmichael-bonshor-a7728156.html.
13.
G. T. Dickson and E. Schubert, "Musical features that aid sleep", Musicae Scientiae, pp. 1029864920972161, 2020.
14.
Z. Hu, Y. Liu, G. Chen, S.-H. Zhong and A. Zhang, "Make your favorite music curative: Music style transfer for anxiety reduction", Proceedings of the 28th ACM International Conference on Multimedia, pp. 1189-1197, 2020.
15.
A. Yamasato, M. Kondo, S. Hoshino, J. Kikuchi, S. Okino and K. Yamamoto, "Characteristics of music to improve the quality of sleep", Music and Medicine, vol. 11, no. 3, pp. 195-202, 2019.
16.
R. J. Scarratt, O. A. Heggli, P. Vuust and K. V. Jespersen, "The music that people use to sleep: universal and subgroup characteristics", 2021.
17.
G. Tzanetakis and P. Cook, "Musical genre classification of audio signals", IEEE Transactions on speech and audio processing, vol. 10, no. 5, pp. 293-302, 2002.
18.
O. Lartillot, T. Eerola, P. Toiviainen and J. Fornari, "Multi-feature modeling of pulse clarity: Design validation and optimization" in ISMIR, Citeseer, pp. 521-526, 2008.
19.
Y. Feng, Y. Zhuang and Y. Pan, "Popular music retrieval by detecting mood", ACM SIGIR, pp. 375-376, 2003.
20.
M. Kos, Z. Kačič and D. Vlaj, "Acoustic classification and segmentation using modified spectral roll-off and variance-based features", Digital Signal Processing, vol. 23, no. 2, pp. 659-674, 2013.
21.
S. Dubnov, "Generalization of spectral flatness measure for non-gaussian linear processes", IEEE Signal Processing Letters, vol. 11, no. 8, pp. 698-701, 2004.
22.
G. W. Milligan and M. C. Cooper, "An examination of procedures for determining the number of clusters in a data set", Psychometrika, vol. 50, no. 2, pp. 159-179, 1985.
23.
J.-Y. Zhu, T. Park, P. Isola and A. A. Efros, "Unpaired image-to-image translation using cycle-consistent adversarial networks", ICCV, pp. 2223-2232, 2017.
24.
M. Pasini, "MelGAN-VC: Voice conversion and audio style transfer on arbitrarily long samples using spectrograms", arXiv:1910.03713, 2019.
25.
O. Ronneberger, P. Fischer and T. Brox, "U-Net: Convolutional networks for biomedical image segmentation", International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2015.
26.
W. Shi, J. Caballero, F. Huszár, J. Totz, A. P. Aitken, R. Bishop, et al., "Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network", IEEE CVPR, 2016.
27.
R. Decorsiere, P. L. Søndergaard, E. N. MacDonald and T. Dau, "Inversion of auditory spectrograms traditional spectrograms and other envelope representations", IEEE/ACM Transactions on Audio Speech and Language Processing, vol. 23, no. 1, pp. 46-56, 2014.
28.
M. Tomczak, C. Southall and J. Hockman, "Audio style transfer with rhythmic constraints", Digital Audio Effects (DAFx), pp. 45-50, 2018.
29.
O. Cífka, U. Şimşekli and G. Richard, "Groove2Groove: one-shot music style transfer with supervision from synthetic data", IEEE/ACM Transactions on Audio Speech and Language Processing, vol. 28, pp. 2638-2650, 2020.
30.
F. Pishdadian, P. Seetharaman, B. Kim and B. Pardo, "Classifying non-speech vocals: Deep vs signal processing representations", 2019.
Contact IEEE to Subscribe

References

References is not available for this document.