Multimodal Music Information Processing and Retrieval: Survey and Future Challenges

Part of book or chapter of book, Conference object, Preprint English OPEN
Simonetta, Federico; Ntalampiras, Stavros; Avanzini, Federico;
  • Publisher: IEEE
  • Related identifiers: doi: 10.1109/MMRP.2019.00012, doi: 10.1109/MMRP.2019.8665366
  • Subject: Multimodal music processing | information fusion | Computer Science - Sound | Electrical Engineering and Systems Science - Audio and Speech Processing | Multimodal music processing, music information retrieval, music description systems, information fusion | music description systems | Computer Science - Multimedia | Settore INF/01 - Informatica | H.5.5 | H.3.3 | Computer Science - Information Retrieval | music information retrieval

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores, mid-level representations, motion, and... View more
  • References (80)
    80 references, page 1 of 8

    [1] I. D. Bent, D. W. Hughes, R. C. Provine, R. Rastall, A. Kilmer, D. Hiley, J. Szendrei, T. B. Payne, M. Bent, and G. Chew, “Notation,” in Grove Music Online. Oxford University Press, 2001.

    [2] H. M. Brown, E. Rosand, R. Strohm, M. Noiray, R. Parker, A. Whittall, R. Savage, and B. Millington, “Opera (i),” in Grove Music Online. Oxford University Press, 2001.

    [3] G. Mumma, H. Rye, B. Kernfeld, and C. Sheridan, “Recording,” in Grove Music Online. Oxford University Press, 2003.

    [4] D. A. Cook and R. Sklar, “History of the motion picture,” in Britannica Academic. Encyclopaedia Britannica, 2018.

    [5] T. Kitahara, “Mid-level representations of musical audio signals for music information retrieval,” in Advances in Music Information Retrieval. Springer Berlin Heidelberg, 2010, pp. 65-91.

    [6] H. Vinet, “The Representation Levels of Music Information,” in Computer Music Modeling and Retrieval, U. K. Wiil, Ed. Berlin, Heidelberg: Springer Berlin Heidelberg, 2004, pp. 193-209.

    [7] F. Pachet, “Musical metadata and knowledge management,” in Encyclopedia of Knowledge Management, Second Edition, D. G. Schwartz and D. Te'eni, Eds. IGI Global, 2005, pp. 1192-1199.

    [8] D. Deutsch, The Psychology of Music (third Edition), third edition ed., D. Deutsch, Ed. Academic Press, 2013.

    [9] P. K. Atrey, M. A. Hossain, A. E. Saddik, and M. S. Kankanhalli, “Multimodal fusion for multimedia analysis: A survey,” Multimedia Systems, vol. 16, no. 6, pp. 345-379, Apr. 2010.

    [10] T. Baltrusaitis, C. Ahuja, and L.-P. Morency, “Multimodal machine learning: A survey and taxonomy,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2018.

  • Metrics
Share - Bookmark