The amount of it would still be dramatically reduced. Those people who are making music solely for the love of it already exist today and people are perfectly welcome to listen to them; nothing is stopping them at all.
I think it's probably safe to say that the vast majority of music that is listened to today would not exist if the artists couldn't financially support themselves from it. Do you really disagree with that?