The playlist refreshes on each load (unless the app caches it).
So when you view the playlist, it will be a different set of tracks (depending on how varied the playlist is to begin with) than what the player will load.
I usually use the context menu to start playing.
Edit: I see what you are saying, if you trigger playback via a song from the list, it doesn’t play that specific song, nor any other song from the initial displayed tracks.
The resulting player queue will be different than the track list displayed in the playlist.
Just like if you back out of the playlist, then go back in, it will be different each time.
@TeknoJunky Just wanted to say, the more I use these randomized playlists, the more I like them. Thanks for coming up with it. The additional variety it provides is really a good thing.