Proxmox LXC Container and GPU Transcoding

This references Intel graphics, but might be of some help:
Installation guide for PMS under Proxmox 5.1 within an LXC Container

Also, current beta, 1.32.5.7210, lets you choose the GPU to use for transcoding, in Settings → Transcoder.