Server Version#: 1.23.4.4712
Player Version#: 4.60.3 (Plex Web)
So I’ve had a huge issue as of today with my server not connecting to anything and it appears due to certificate issues.
For context I have done these steps to try and troubleshoot:
- Removed and reclaimed the server
- Restarted multiple times
- Adjusted all “Secure” settings
- Reset the NTP Client on my Ubuntu VM
- Changed NAT’d port
- Pulled a packet capture to try and look at the network traffic.
- Double checked pfSense’s DNS rebinding advanced setting
Finally I turned on verbose logging and started looking at log traffic and at first glance it looks like I am hitting some type of rate limit uploading the certificate that the server gets from Plex.
Based on the logs below it looks like I am hitting some type of rate limit on the API that is breaking my servers certificate.
Anyone out there have any insight?
Log output:
Jul 04, 2021 03:30:01.461 [0x7f76fe063b38] DEBUG - Completed: [**Redacted**:18638] 200 GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP 20000ms 5 bytes (pipelined: 273)
Jul 04, 2021 03:30:01.474 [0x7f76fe040b38] DEBUG - Auth: authenticated user 1 as **Redacted**
Jul 04, 2021 03:30:01.474 [0x7f76fcd88b38] DEBUG - Request: [**Redacted**:18638 (WAN)] GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP Signed-in Token (**Redacted**)
Jul 04, 2021 03:30:01.474 [0x7f76fcd88b38] DEBUG - Content-Length is -1 (of total: -1).
Jul 04, 2021 03:30:16.965 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:16.966 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:16.967 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:17.053 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:21.475 [0x7f76fe063b38] DEBUG - Completed: [**Redacted**:18638] 200 GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP 20001ms 5 bytes (pipelined: 274)
Jul 04, 2021 03:30:21.479 [0x7f76fe040b38] DEBUG - Auth: authenticated user 1 as **Redacted**
Jul 04, 2021 03:30:21.479 [0x7f76fcd88b38] DEBUG - Request: [**Redacted**:18638 (WAN)] GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP Signed-in Token (**Redacted**)
Jul 04, 2021 03:30:21.479 [0x7f76fcd88b38] DEBUG - Content-Length is -1 (of total: -1).
Jul 04, 2021 03:30:41.480 [0x7f76fe063b38] DEBUG - Completed: [**Redacted**:18638] 200 GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (3 live) TLS GZIP 20001ms 5 bytes (pipelined: 275)
Jul 04, 2021 03:30:41.483 [0x7f76fe040b38] DEBUG - Auth: authenticated user 1 as **Redacted**
Jul 04, 2021 03:30:41.483 [0x7f76fcd88b38] DEBUG - Request: [**Redacted**:18638 (WAN)] GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (3 live) TLS GZIP Signed-in Token (**Redacted**)
Jul 04, 2021 03:30:41.483 [0x7f76fcd88b38] DEBUG - Content-Length is -1 (of total: -1).
Jul 04, 2021 03:30:46.962 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:46.964 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:46.970 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:47.067 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:30:50.217 [0x7f76fce97b38] DEBUG - CERT: Forcing refresh.
Jul 04, 2021 03:30:50.219 [0x7f76fce97b38] DEBUG - CERT: Certificate expires soon, fetching a new one.
Jul 04, 2021 03:30:50.219 [0x7f76fce97b38] DEBUG - HTTP requesting GET **API Formatted URL**
Jul 04, 2021 03:30:50.793 [0x7f76fce97b38] DEBUG - HTTP/1.1 (0.6s) 200 response from GET **API Formatted URL**
Jul 04, 2021 03:30:50.794 [0x7f76fce97b38] DEBUG - HTTP requesting PUT **API Formatted URL**
Jul 04, 2021 03:30:50.959 [0x7f76fce97b38] DEBUG - HTTP/1.1 (0.2s) 429 response from PUT **API Formatted URL** (reused)
Jul 04, 2021 03:30:50.959 [0x7f76fce97b38] ERROR - CERT: Error acquiring new certificate: Failed to upload CSR: 429, <?xml version="1.0" encoding="UTF-8"?>
<errors>
<error code="1003" message="API rate limit exceeded"/>
</errors>
Jul 04, 2021 03:31:01.484 [0x7f76fe063b38] DEBUG - Completed: [**Redacted**:18638] 200 GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP 20001ms 5 bytes (pipelined: 276)
Jul 04, 2021 03:31:01.498 [0x7f76fe040b38] DEBUG - Auth: authenticated user 1 as **Redacted**
Jul 04, 2021 03:31:01.498 [0x7f76fcd88b38] DEBUG - Request: [**Redacted**:18638 (WAN)] GET /player/proxy/poll?deviceClass=pc&protocolVersion=3&protocolCapabilities=timeline%2Cplayback%2Cnavigation%2Cmirror%2Cplayqueues&timeout=1 (7 live) TLS GZIP Signed-in Token (**Redacted**)
Jul 04, 2021 03:31:01.498 [0x7f76fcd88b38] DEBUG - Content-Length is -1 (of total: -1).
Jul 04, 2021 03:31:02.572 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:31:02.581 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:31:16.932 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:31:16.934 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:31:16.936 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown
Jul 04, 2021 03:31:17.029 [0x7f76fe040b38] DEBUG - CERT: incomplete TLS handshake: sslv3 alert certificate unknown

