Is hw transcode on nvidia officially supported?
Last I checked, it wasn’t. As long as you install the correct drivers and cuda, hw encode worked, but not hw decode.
I figured out that it was due to a missed build flag (for enabling cuvid) when compiling plex’s ffmpeg fork. I brought it to the devs’ attention but they said nvidia wasn’t officially supported so they wouldn’t fix it
Edit: Found it : NVIDIA GTX 770 hardware transcoding on Debian 9
And more details here: Plex Media Server - Hardware Transcoding Preview 4 (1.8.1.4140)