Plexamp on Android device will only connect to my PMS after I turn off my VPN

Post some Plexamp logs so we can see what IPs it’s trying to hit. You can alter that by publishing custom access URLs via server preference.