Device settings for supported/primary audio

See this feature request. It discusses setting default audio formats on a per-client basis. It may cover the situation you describe.

Automatically Set Preferred/Default Audio For Videos (audio format/codec)