Windows Server 2016 Crashes / K4000 Video Card

Server Version#: 1.13.7.5369-93c9f1259
Player Version#: Web Player / Chrome
Logs attached Plex Media Server Logs_2018-09-07_00-26-06.zip (2.9 MB)

As of I’d say about a month or two ago, I’ve had random crashes with Plex and my K4000 (I believe). The first few times I’d see an error for an nvidia driver in the logs for Windows Server 2016, but as of last week I’ve stopped seeing those errors in Windows, but Plex continues to crash.

Using Windows Server 2016 with a K4000 on a Poweredge R720 and when it works, its amazing. Sometimes it’ll be fine for 2-3 days, other times Plex will crash back to back for an hour or more.

There was a crash when Plex Media Server was testing out the hardware encoder - it crashed in the nvidia dll

STACK_TEXT:  
0221b46c 6f49fa25 8475cfb0 00000000 0a83e278 nvcuvid+0x130781
0221b48c 6f45d5e6 089fe8c0 090f2ed8 00000000 nvcuvid+0x12fa25
0221b520 6f4561b8 0a92fd2c 8475ce6c 000427b0 nvcuvid+0xed5e6
0221b550 70d2a7dc 0a92fd2c 08563c98 08c93938 nvcuvid+0xe61b8
0221cb98 70d26024 08563c98 9beafc97 08c93938 nvEncodeAPI+0x1a7dc
0221cbc4 70d3811c 0a92fc98 9beafb6b 00000000 nvEncodeAPI+0x16024
0221cc38 72e969e6 08c93938 056d8a90 000002d0 nvEncodeAPI+0x2811c
0221de98 72e97a1e 00000000 00000028 00000028 avcodec_58+0x1e69e6
0221e238 00000000 00000000 72ec6f40 0000001b avcodec_58+0x1e7a1e

with the dlls being

C:\Windows\System32\nvcuda.dll
C:\Windows\System32\nvcuvid.dll
C:\Windows\System32\nvapi.dll
C:\Windows\System32\nvEncodeAPI.dll

Could you see if there are any firmware updates and also let me know exact versions and model of hardware

The only firmware updates available look to be bios updates which would ramp my fans up a good amount, so I’d like to (if possible) avoid updating that.

System:
Windows 10 Server 64bit, Ver 1607
GPU: Quadro K4000 running driver 398.26 (using the cuda drivers) - https://i.imgur.com/alH42az.png
MB: Dell R720 (Bios: 1.3.6)
CPU: Dual E5-2640
RAM: 48 Gigs

I’ve reinstalled the nvidia drivers a few times, reinstalled the cuda drivers, have updated plex

Thank you - i am referring this to nVidia team. Does hardware acceleration work at all ? If not, suggest you disable it in Plex Media Server Settings for the Transcoder until the issue is known and resolved

Thanks!

It works, it’s just at random times it’ll crash. Sometimes it’ll be solid for weeks with no issues while other times it’ll crash 2-3 times a day. I’ll go ahead and disable it for the time being while waiting a fix. Thanks!

Any possible new updates? Still seems to be happening :frowning:

Bumping —

Have asked the NVIDIA Team to enquire and find status from their Desktop team.

Just a quick update as well - I’ve downloaded the latest video drivers from nvidia, reinstalled the cuda drivers, disabled the onboard video on the PowerEdge, updated the BIOS. The only thing I haven’t done is reinstall Windows which might be the next step. Ideas, suggestions?

It works for awhile, then just crashes and repeats. Would replacing the K4000 with something else be the best bet here?

What version is the latest video driver that you installed and the CUDA SDK version ? NVIDIA team would like to know the failure rate with these drivers

and could I have the latest crash dmp and associated server logs

The NVIIDA Desktop team are after steps to follow to reproduce the crash.

Sure thing
Imgur

nVidia Drivers: 412.16
SMI: 412.16
Cuda Version: 10

Steps: Installed Drivers, enabled Plex HW Transcoder, let it sit anywhere from 1 hour up to 48, will crash sooner or later. It ranges from crashing with no one transcoding all the way to crashing with 12+ on it.

My Crash Logs are empty (my fault, deleted everything last time I crashed 5 days ago). I just re-enabled HW Transcoding. When I crash I’ll update the thread with the new logs.

Appreciate you following back around and looking into it again.

Thanks - do you have the registry change for windows to capture the crashes and create the dmp file ? Or default of plex media server creating the dmp and reporting it with the server setting for crash reporting enabled ? If it is the latter, server debug logs zip after the restart following the crash would be needed to locate the crash report and also to have info on what was being done

I am surprised it crashes when no transcoding. Are you sure it is the sane crash in the driver

Here is the dump file found in %LOCALAPPDATA%\CrashDumps as well as the Plex Server Logs - I’m not sure if it’s the same crash as before, all I know is it’s been happening since the beginning so I wager it’s the same crash.

It was fine for about 6 hours and transcoded a few streams before it crashed. If it would automatically restart I’d just live with it but it stays hung on the task bar until I mouse over the icon

Plex Media Server Logs_2019-02-04_16-15-42.zip (2.8 MB)
PlexTranscoder.exe.9520.rar (311.5 KB)

Thanks - Was there not a Plex Media Server.exe dmp file as well created at the same time - Feb 04 at around 12:18:17 ?

Also please see if the is a Plex Crash Uploader log file started around same time

(in C:\Users\Administrator\AppData\Local\Plex Media Server\Logs)

There was not actually - https://i.imgur.com/kinFLHl.png

There is also no new report for the uploader on the crash that took place at 12:18:17, however the other upload reports would be me turning on the transcoder and it crashing - attached

Logs.rar (1.6 KB)

Alright, I ended up crashing again today even with a new video card (P2000). Looking at the logs it crashed right after

DEBUG - Codecs: testing hevc_mf (encoder)

I’ve attached my logs, and the windows dump file in hopes it helps.

Plex Media Server Logs_2019-02-12_19-56-30.zip (2.6 MB)
Plex Media Server.exe.6828.rar (1.7 MB)

Thank you

Versions of drivers etc as before please