As far as I know even if you have an X server running and VAAPI on FreeBSD or FreeNAS, hardware accelerated transcoding is not possible.
Will there ever be a way to use a GPU on FreeBSD/FreeNAS to accelerate transcoding?
I’m really hoping someone can give some insight here. I’ve been using FreeBSD on my NAS for years but for me this is important enough that I’ll switch to Linux if needed.
I think that the OS you’re using doesn’t support hardware accelerated transcoding, hence why most people use UnRaid as an OS for Plex Media Sever. Don’t quote me on this because I’m not 100% sure.