Go for stereo audio only.
If your source is a surround sound format, try to apply compression and attenuate the center channel during downmix.
You can modify the parameters in this post to achieve a file with one audio track only.
If you have subtitles, convert them to SRT format, because it is the one which doesn’t require transcoding on most client types.