AMD for HW-transcoding, or Intel/Nvidia only?

You cannot use AMD. We do not support that.

https://support.plex.tv/articles/115002178853-using-hardware-accelerated-streaming/