GENPIA: A Genre-Conditioned Piano Music Generation System

Quoc Viet Nguyen, Hao Wei Lai, Khanh Duy Nguyen, Min Te Sun, Wu Yuin Hwang, Kazuya Sakai, Wei Shinn Ku

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the demand for music continuing to grow as people seek variety and personal resonance, many works focus on music generation. In this study, we propose GENPIA, a genre-conditioned piano music generation system. The system encompasses Anime, R&B, Jazz, and Classical music genres. To build our system, we collect and label audio data of various genres for the specific objective of our research. REMI audio representation with genre information extension is applied during data pre-processing to present the audio data with a better data structure. Transformer-XL is implemented as the model to learn knowledge about the extended audio representation and generate the desired output audio. An external dataset, called Ailabs.Tw lK7, is utilized for pre-Training purposes. The results obtained from a listening questionnaire show that GENPIA can generate better piano pieces conditioned on different genres compared to the prior state-of-The-Art work.

Original languageEnglish
Title of host publicationIEEE 5th International Symposium on the Internet of Sounds, IS2 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350366525
DOIs
StatePublished - 2024
Event5th IEEE International Symposium on the Internet of Sounds, IS2 2024 - Erlangen, Germany
Duration: 30 Sep 20242 Oct 2024

Publication series

NameIEEE 5th International Symposium on the Internet of Sounds, IS2 2024

Conference

Conference5th IEEE International Symposium on the Internet of Sounds, IS2 2024
Country/TerritoryGermany
CityErlangen
Period30/09/242/10/24

Keywords

  • GENPIA
  • Genre-condition
  • Piano music generation
  • Transfromer-XL

Fingerprint

Dive into the research topics of 'GENPIA: A Genre-Conditioned Piano Music Generation System'. Together they form a unique fingerprint.

Cite this