My wife has now complained to me a couple times that the “Up Next” list is just not long enough. She added an album to the queue, with the intent to remove 1 or 2 songs later in the album, but was unable to do so given how few tracks are visible in the Up Next list. This was also a situation where she wouldn’t easily be able to just wait until those songs were closer to the top of the list to remove them.
I’ve also found this frustrating at times. I don’t like needing to regularly interact with the queue just to swap the order of a couple songs, or remove something I don’t feel like hearing or whatever.