Is there a way to rename an Apple TV player?

I currently have multiple Apple TVs I use for Plex, however when remote controlling them via another device they show up with identical names, making it trial and error when trying to determine which one is the correct one. Is there any way the Plex app can get the name directly from the OS? Or failing that, a way to configure a name manually?

Good question!

See Apple TV - Device Name - Unable to Adjust.