Remote access works, except via app.plex.tv

Can you access your Plex server when connected to an external network via app.plex.tv? Try a test using a mobile device which is disconnected from your local wifi network.

Try some of the investigative and troubleshooting steps in this thread.