Plex says "The Server is not powerful enough..." but server is only using ~30% CPU

I would look at this thread: Transcoding 4k Requirements. Best solution always is to have your media in a format compatible with your player specs, then no transcoding is required.