How to remove old server from Plex Web?

Is it a your server or a server shared with you?

If the latter, go to Settings → Manage Library Access and delete the server/libraries shared with you.