Having the issue here as well for the last few days on both of my Samsung TVs.
sign out and back in gets my main user acct back to normal but whatever the last user to sign in is ends up overwriting all the others continue watching and library access. Basically some sort of leak where it looks like you’re swapping users but it’s still stuck on the last one to load in.
Only work around I found for now is putting a pin on all accts. Only my admin had one before, I put 5555 on all the others for now and it seems to be behaving as expected and the actual user profile is loading in for each person.