I think what most people are saying is that when it comes to music, it isn't just about "noise". A kid crying is a kid crying. People talking are just people talking. But music playing becomes what music playing, why is the music playing, etc.
A kid crying comes and goes. People talking comes and goes. Usually a dog barking comes and goes. But when people play music, it is continuous for a long time. Most popular music is about 3-5 minutes per song. If someone plays 12 songs, that's an hour non-stop of someone else's preferred choice. People don't want to listen to other peoples' choices for that long.
In addition, the ability to eliminate music from the noise mix is easy - turn off the radio/CD/mp3/record/tape. The ability to eliminate people talking, kids crying, dogs barking, etc. from the noise mix is pretty much impossible.
