Debian 11 branch 5700 XT transcoding not working

It all depends on your media, what your describing sounds about right. (What kind of CPU do I need for my Server? | Plex Support)

Windows would allow access to the driver but then you have other issues like you can’t run it as a service or use it headless.

Did you see this thread? (Got HW Transcoding to work with libva/vaapi on Ryzen APU (Ryzen 7 4700U))