MOODetector: A System for Mood-based Classification and Retrieval of Audio Music
Description
This project addresses the topic of Music Emotion Recognition. Research topics: feature extraction, selection and evaluation; extraction of knowledge from computational models; tracking of mood variations.
“Music’s preeminent functions are social and psychological”, and so “the most useful retrieval indexes are those that facilitate searching in conformity with such social and psychological functions. Typically, such indexes will focus on stylistic, mood, and similarity information” (David Huron, 2000). This is supported by studies on music information behaviour that have identified music mood as an important criterion for music retrieval and organization.
Besides the music industry, the range of applications of mood detection in music is wide and varied, e.g., game development, cinema, advertising or the clinical area (in the motivation to compliance to sport activities prescribed by physicians, as well as stress management).
Compared to music emotion synthesis, few works have been devoted to emotion analysis. From these, most of them deal with MIDI or symbolic representations. Only a few works tackle the problem of emotion detection in audio music signals, the first one we are aware of published in 2003. Being a very recent research topic, many limitations can be found and several problems are still open. In fact, the present accuracy of those systems shows there is plenty of room for improvement. In a recent comparison, the best algorithm achieved 65% classification accuracy in a task comprising 5 categories (MIREX 2010). The effectiveness of such systems demands research on feature extraction, selection and evaluation, extraction of knowledge from computational models and the tracking of mood variations throughout a song. These are the main goals of this project.
Researchers
Funded by
FCT: PTDC/EIA-EIA/102185/2008
Partners
None
Total budget
77 304,00 €
Local budget
77 304,00 €
Keywords
Music Emotion Recognition, Music Information Retrieval
Start Date
2010-05-16
End Date
2013-11-15
Journal Articles
2018
(2 publications) - Malheiro, R., and Panda, Renato and Paulo Gomes and Paiva, R.P. , "Emotionally-Relevant Features for Classification and Regression of Music Lyrics", IEEE Transactions on Affective Computing, vol. 9, pp. 240-254, 2018
- Panda, Renato and Malheiro, R., and Paiva, R.P. , "Novel audio features for music emotion recognition", IEEE Transactions on Affective Computing (early access), 2018
2015
(1 publication) Conference Articles
2018
(1 publication) 2016
(2 publications) - Malheiro, R., and Panda, Renato and Paulo Gomes and Paiva, R.P. , "Classification and Regression of Music Lyrics: Emotionally-Significant Features", in 8th International Conference on Knowledge Discovery and Information Retrieval – KDIR’2016, 2016
- Malheiro, R., and Panda, Renato and Paulo Gomes and Paiva, R.P. , "Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset", in 9th International Workshop on Music and Machine Learning – MML’2016 – in conjunction with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases – ECML/PKDD 2016, 2016
2013
(4 publications) - Malheiro, R., and Panda, Renato and Paulo Gomes and Paiva, R.P. , "Music Emotion Recognition from Lyrics: A Comparative Study", in 6th International Workshop on Machine Learning and Music, 2013
- Rocha, B.M.M. and Panda, Renato and Paiva, R.P. , "Music Emotion Recognition: The Importance of Melodic Features", in 6th International Workshop on Music and Machine Learning – MML’2013 – in conjunction with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases – ECML/PKDD 2013, Prague, Czech Republic, 2013
- Panda, Renato and Rocha, B.M.M. and Paiva, R.P. , "Dimensional Music Emotion Recognition: Combining Standard and Melodic Audio Features", in 10th International Symposium on Computer Music Multidisciplinary Research – CMMR’2013, Marseille, France., 2013
- Panda, Renato and Malheiro, R., and Rocha, B.M.M. and António Oliveira and Paiva, R.P. , "Multi-Modal Music Emotion Recognition: A New Dataset, Methodology and Comparative Analysis", in 10th International Symposium on Computer Music Multidisciplinary Research – CMMR’2013, Marseille, France., 2013
2012
(3 publications) - Panda, Renato and Paiva, R.P. , "Music Emotion Classification: Analysis of a Classifier Ensemble Approach", in 5th International Workshop on Music and Machine Learning – MML’2012 – in conjunction with the 19th International Conference on Machine Learning – ICML’2012, 2012
- Panda, Renato and Paiva, R.P. , "Music Emotion Classification: Dataset Acquisition and Comparative Analysis", in 15th International Conference on Digital Audio Effects – DAFx’12, 2012
- Panda, Renato and Paiva, R.P. , "MIREX 2012: Mood Classifcation Task Submission", in Music Information Retrieval Evaluation eXchange - MIREX'2012, 2012
2011
(3 publications) - Panda, Renato and Paiva, R.P. , "Using Support Vector Machines for Automatic Mood Tracking in Audio Music", in 130th Audio Engineering Convention - AES 130, 2011
- Panda, Renato and Paiva, R.P. , "Automatic Creation of Mood Playlists in the Thayer Plane: A Methodology and a Comparative Study", in Sound and Music Computing Conference - SMC'2011, 2011
- Cardoso, L.F.A. and Panda, Renato and Paiva, R.P. , "MOODetector: A Prototype Software Tool for Mood-based Playlist Generation", in Simpósio de Informática - INForum 2011, 2011