I should note that the issue only started occurring when I upgraded my server from Windows 2012 R2 to Windows 2019. Prior to that the Enhanced Video Player was working fine.
Similar issue: https://forums.plex.tv/t/enhanced-video-player-on-apple-tv-4k-creating-buffering-issues