This post basically describes what happens when the PS5 doesn’t stop buffering :
Changing to an older server version seems to fix the problem.