Plexamp will already find songs of artists on compilations where they’re not listed as the album artist.
There’s already an existing suggestion discussing an option to fully support tracks with more than one artist (e.g. mutual projects, featured artists…). I suggest you comment/vote in that thread in order to help us avoid distracting or cannibalizing votes.
