A 4GB gtx 1650 should do three 4K > 1080 transcodes so 30-40% for one stream is about right.
Have a look at this thread , if you have already done those step then it is time to look at some logs of a failed playback session.
The only other oddball thing I can think of involves disabling one of the CPU’s to eliminate process/memory cpu to cpu copies.
