HW Transcoding not using Nvidia GPU

Server Version#: 1.42.2.10156
Player Version#: 4.147.1

Hello all,

Hoping someone can help me figure out why I can’t get hardware transcoding to work. I just moved my plex media server to a new server. I did have it installed as a docker through the official docker app on Unraid, but I’m changing NAS servers and instead configured it in a Ubuntu 24.04 VM on Proxmox.

I passed through a 5060 Ti to the Ubuntu VM. Installed the most recent drivers (used ubuntu-drivers install). Everything is working except HW transcoding. If I go to the server Transcoder settings, Use hardware acceleration is checked, but under the Hardware transcoding device, the only option is Auto. That doesn’t seem right because in another test configuration with a Tesla P4, I saw the Tesla P4 listed in that drop down.

I don’t know why, nor how to figure out why it’s not picking up my 5060 Ti as a transcoding device.

lspci -v shows that the kernel driver in use is nvidia.

nvidia-smi works and shows the 5060 ti.

I do have a plex pass.

I don’t really intend on using the 5060 ti for this long term, it’s just in the server right now while I’m trying to get things configured until I get everything transferred over to my new nas and can pull the Tesla P4 out of my old system. But, I would really like to have hw transocding working in the mean time until I can get that done.

I’ve had the most luck using LXC’s instead of VMs.
The hardware is passed in better

To make it easier (I’m not good with Proxmox), I used TTECK helper scripts as the base.

I do know, just as if it were VMWare, you need the physical passthrough and the VM needs the Nvidia drivers again where LXCs do not

Hmm, I don’t think using a container is really an option for me right now. I have other nvidia GPUs in this system passed through to other VMs, so all nvidia GPUs are blacklisted in the Host OS.

I don’t really see any reason for it to not be working as it is in the VM. I’ve successfully used this same card in pass through for other things, playing with some local LLMs and as a pass through in a VM desktop for gaming. HW Transcoding in plex is the first thing I’ve had a problem with. So it either seems to be something particular with plex, or there is some extra configuration step I’m missing, but I haven’t been able to find anything mentioned anywhere for it.

I did find one thing saying something about ffmpeg in plex is out dated and doesn’t work with the nvenc encoder on the 50 series cards, but I don’t know how reliable that information is as I’ve seen other reports of people successfully using 50 series cards for transcoding in plex. Also, considering the 50 series has been out for nearly a year now, I would hope plex isn’t that far behind in updating components lol.