Delete library remains pinned with a "yellow warning mark"

Actually, all you have to do is unpin the deleted library and it will go away.