It all depends on your media, what your describing sounds about right. (What kind of CPU do I need for my Server? | Plex Support)
Windows would allow access to the driver but then you have other issues like you can’t run it as a service or use it headless.
Did you see this thread? (Got HW Transcoding to work with libva/vaapi on Ryzen APU (Ryzen 7 4700U))