Did you clear the cache under
Settings - Playback - Cache
before starting playback?
Do this while playback is totally stopped. You stop with a long press on the Pause button.
If you did do the above without any other results, recreate the situation, then fetch and post the Plexamp logs (zipped please).