You said the ID3 tags are correct, but is Plex configured to prefer embedded tags?
Is the Album Artist tag in each of these files populated? If they are blank, that may be a problem.
Could you screenshot your tagging app showing at least these tags:
Filename, Album Title, Track Title, Album Artist, Track Artist, Disc Number, Track Number
