I’m having very similar symptoms with my Chromecast with Google TV and have been for a number of months.
Skipping forwards or backwards often causes the player to do huge jumps in time, far more than I’ve requested it to do. The file then pretty much becomes unplayable (as in I can’t reliably seek to where I want to get via any seeking method). The stream has to be started again and you have to hope it’ll seek reliably to the right place. It happens often with 720p h264 TV eps (which I tend to consume most). I disabled direct play a long time ago so almost all content direct streams.
Almost bad enough to make me switch back to the Samsung app but that’s broken without permitting insecure connections from what I gather
Will post back with logs and versions tomorrow night.