Slow interface

I find that the Plex interface on Xbox One is really slow to browse. For instance if I click on music -> browse it takes it 5+ sec to show the thumbnails and same thing happens when I click play on a song. Takes so long I start to wonder if the Xbox got the command.

It’s not just those specific scenarios, the interface is in general really slow and I have to wait several seconds from pressing the button on the remote until the app has reacted and finished loading.

Not sure where I would have a bottleneck. My PC which the server is running on is on the same LAN as my Xbox One and they are connected with two gigabit Ethernet cables running through one gigabit Ethernet switch. The PC itself is really modern with a NVMe SSD and a Intel 6700K with 32GB of RAM so it should be able to serve up all the meta data really quickly.

Has anyone else experienced the same thing?