Make the server "invisible" to specific users

Early 2021 clean-up: duplicate (focusing on the same requirement)