I have the same Problem on Xbox Series X…
Netflix on XBSX works perfect. Plex direct over the Smart TV works perfect. But Plex on XBox is very bad to Watch Movies with HDR and/or 4K.
Other Forums report the same Problem. And the issue are on both Platforms. Xbox an Playstation