I have been playing around with my ID3 tags for a while but I can’t seem to get the result I want.
I first tried tagging “Artist” and “Album Artist” the same but it resulted in duplicate albums in Plex - which does make sense I guess.
After that I tagged “Album Artist” as Various artists instead and now everything is pooled together in a single album just like I wanted it.
The individual artists do get listed behind each track but there is no artist page for them.
For example, the Guardians of the Galaxy album features the song “Hooked On A Feeling” by Blue Swede. This gets listed correctly in the album but I can’t search for “Blue Swede” and get a proper artist page with all the songs of this artist since this is the only one I have.

Another example would be “Moonage Daydream” by David Bowie. If I search for David Bowie I get the proper artist page because I have more albums of him. However, the Guardians of the Galaxy album is not listed there because it is tagged for various artists.

Is there a way around this?
It seems like the Guardians of the Galaxy album belongs on the artist page of David Bowie and Blue Swede deserves to get an own artist page. I’m not sure if Plex is even able to do this, if not then this is also a feature request at the same time.
