You need to activate this.
Download mkvtoolnix and use the header editor to set the forced flag on the appropriate subtitle stream.
See How to remove tag spam and set language in several MKV files at once for an idea how to do the same for a whole season (requires all files to have identical make up).
