Jerky / stuttering playback

I’m having an issue with jerky video playback during action and scenes where camera pans. I have a mix of MKV and MP4 files. It doesn’t seem to matter if they are using direct play or if the server is transcoding. The settings for smooth motion are off on the TV. I’m using a wired LAN connection. Anyone else been seeing this or have any suggestions?

I’m seeing the same almost daily. it’s usually fixed for the rest of the evening by doing a full reboot of the xbox (I’m on the Xbox preview program)