Comment by rajivayyangar
1 day ago
The results strike me as comparable or worse than you could get with a Markov model. I think it reveals the gap in understanding between LLMs and music. I think you need to either: - Set up a pipeline to decompose music into, say, harmonic sequences and melodic sequences, and then have the LLM work on some more fundamental or more high-level layer of musical composition and then re-translate it back into actual sounds. - Develop a better dataset and train the LLM more natively on musical examples.
Does anybody know of a project that has produced more convincing results?
I'm not at all there yet, but this sort of thing is on my roadmap for my AI music project at tunesage.com ... That is, generating musical ideas while being conscious of phrase / melodic / thematic structure that a user can then play around with.
While LLMs (and ANNs in general) are definitely great for musical analysis (though still limited), I think they're likely overkill for the generation part, plus they tend to suffer from "creative collapse" as they prefer averages rather than exploration (which can be good or bad depending on what you want).
There is no LLM in the ML pipeline provided by the OP.