Make sure you saved your changes after you ticked this box
3 dots next to the library → Manage Library → Edit → Advanced
Manually rescan the library and then refresh the metadata for the items you changed
As a last resort Plex Dance one of the files and see if it shows up correctly after you readd it
