Making explicit the formalism underlying evaluation in music information retrieval research

a look at the mirex automatic mood classification task

Bob L. Sturm

pp. 89-104

in: Mitsuko Aramaki, Olivier Derrien, Richard Kronland-Martinet, Sølvi Ystad (eds), Sound, music, and motion, Berlin, Springer, 2014

Abstract

We make explicit the formalism underlying evaluation in music information retrieval research. We define a 'system," what it means to "analyze" one, and make clear the aims, parts, design, execution, interpretation, assumptions and limitations of its "evaluation." We apply this formalism to discuss the MIREX automatic mood classification task.