So while trying to cast music from any Plex android app to Google Home Speakers I would always have a 20+ second delay for every song to start.
Here’s How I fixed it:
On your local Plex Server --> Settings–> Network
Uncheck the box for “Enable Relay”
Now my music plays instantly.
Update My Roku also loads a heck of a lot faster when playing videos! yay!