Would adding musical notations to LLMs training data allow it to create music since notations are a lot like normal languages? Or does it do so already?
Would adding musical notations to LLMs training data allow it to create music since notations are a lot like normal languages? Or does it do so already?
ChatGPT appears to be able to generate music in lilypond notation. It gets the notation, but not the music. You could probably fine tune a model on some lilypond files to get better results.
I tried getting it to write out a simple melody using MIDI note numbers once. I didn’t think of asking it for LilyPond format, I couldn’t think of a text-based format for music notation at the time.
It was able to produce a mostly accurate output for a few popular children’s songs. It was also able to “improvise” a short blues riff (mostly keeping to the correct scale, and showing some awareness of/reference to common blues themes), and write an “answer” phrase (which was suitable and made musical sense) to a prompt phrase that I provided.