This did resolve the issue for collections, many thanks for the hint. Categories still fail on all kind of clients, but that’s a minor issue for my use case. Probably there is a a timing issue. At least Plex failed for most cases when I tried to put the data on on USB disks whereas local SSD work perfect.
Categories are just “Genre” filters.
If you observe slow speed when filtering your library by Genre, then you should investigate whether your Plex data folder is located on a particularly slow volume. Or a volume is nearly full.
Or the primary database file is damaged and cannot generate speed-enhancing index tables.
Sometimes also the media file organization plays a role. (for instance, putting all movies together in one big folder can cause major performance issues)