Your not the only one but I suspect we are in the minority who see it as a problem → Build a Smart Playlist based off Track Rating with secondary filter to remove Duplicates?
Have a look at my last comment which might be a workaround for you and I quote it here also …
Interestingly, I noticed today that if duplicate tracks exist on a playlist selecting to shuffle the playlist removes the duplicates !
I also spun up this feature suggestion → Add Duplicate to Advanced Filters so Multiple same track results can be Filtered but kinda feel like I’m talking to myself sometimes 
