I just found another thread that explained this issue. Looks like it happens when there are multiple files for one movie or episode and the audio needs to be transcoded.
Once I deleted the 2nd version of an episode having this issue, it was able to play without any issues.