You could try extracting the plex.direct key for your Plex server as discussed in the thread Decrypting the plex.direct certificate? and then install that key for use on your reverse proxy.
There have also been issues recently reported by many users with the remote access indicator being red, or only being momentarily green, despite no changes to configuration. Refer to:
