You can already do that…
Just hold / long-press the item for a moment – once you can rearrange, the selected item should have a darker background/highlight. On iOS I also get a short haptic feedback.
From there on it’s just dragging the item to the place.
There’s already an existing suggestion to edit the entire queue (not just the already displayed items).
