Plexamp Pi With a Desktop - Setup Guide for Plexamp on the Raspberry Pi

Or install using a script: https://forums.plex.tv/t/plexamp-installer-for-raspberry-pi-with-arm64-hw

You can change the user you want plexamp to run as during script execution.