Do you have to have Plex Pass to download music on your android phone (using Plex app) for offline playing of the music?
Yes. The account downloading needs a Plex Pass, or be in the Plex Home of someone with a Plex Pass. More info on downloads can be found here.
( the server admin must also allow you to download from them)
