@pk_plex is correct. If credit detection (and intro) has been completed for a movie/series and you disable the server side settings it will only stop new credit detection from happening. It won’t clean up previously detected credits.
If you want it actually deleted you have to either plex dance the movie/series or also disable it within the individual library advanced settings. That will remove it after analysis is complete.