Music stores primarily sell recorded music (vinyl/CDs). They can also be called "record shops" or "record stores". They may sell other related things (posters, books about bands or DVDs of live concerts) in small quantities, but they call themselves a music shop.
