Is your server setup for remote access?
The Xbox One client is restricted from browsing the local network so it does require remote access to be setup so the client can pull your server’s information from Plex.tv. After that everything is done locally.
