There is no way in the user interface.
There might be a way if you access the server API directly.
See Reset all manual poster selections in a library at once or unlock other metadata fields for an example.
Hint: type would be 10 for a music track and the name of the entity is userRating which you need to set to 0
