It might be due to the same files having incorrect names and folder organization before.
Plex memorizes a file’s contents (to a degree) and can recognize a file even if it changed its name.
I recommend you to restore the recommended naming schema (don’t forget the subfolders per season), then perform the Plex Dance to make Plex forget what those files looked like and treat them as completely unknown.
