Plex Server seeing '/' character in collection name as seperate collections

Did you install the .nfo importer agents ?
Because otherwise Plex doesn’t care about what you do in Ember.

And if you indeed use the .nfo importer agents, then I think it is better to report the issue to their author.