I think those ratings are found and applied by Plex if you have “Album Reviews and Critic Ratings” enabled in your music library. Check the advanced tab where you can edit the Music Library, and try disabling that.
Probably have to refresh metadata for the Artist and/or Album after that. Plex really likes to hold onto metadata it has downloaded. If that fails try the Plex Dance for the album.
