Plex Android app is garbage

Plex is annoying to the point that I might just stop listening to music on my phone.

Have you tried Plexamp? It’s specifically designed for music, and was only just made available to users who don’t have a Plex Pass. The only downside I know of is that a single download (playlist, artist) is limited to 24 hours, which is a dealbreaker for some, but not an issue for others.