Transcoding HEVC suddenly not working in 1.32.5.7210 (FreeBSD)

Plex Media Server
1

Server Version#: 1.32.5.7210
Player Version#: 4.108.0
Note: NO HW accelerated encode or decode.

Previously, Plex would transcode 10-bit HEVC files just fine on this system (Dual Xeon X5677, so enough CPU horsepower to keep up), but since updating to 1.32.5.7210, transcodes are failing with the message “Not enough CPU” and the log notes video.bitDepth limitation applies: 10 > 8

Any way I can fix this?

Relevant part of debug log:

Jul 01, 2023 20:31:29.700 [0x80f520e00] DEBUG - [Req#12d96c/Transcode/Req#12d96d] We're going to try to auto-select an audio stream for account 1.
Jul 01, 2023 20:31:29.700 [0x80f520e00] DEBUG - [Req#12d96c/Transcode/Req#12d96d] Selecting best audio stream for part ID 327465 (language: en)
Jul 01, 2023 20:31:29.700 [0x80f520e00] DEBUG - [Req#12d96c/Transcode/Req#12d96d] We're going to try to auto-select a subtitle.
Jul 01, 2023 20:31:29.700 [0x80f520e00] DEBUG - [Req#12d96c/Transcode/Req#12d96d] Audio Stream: 587774, Subtitle Stream: -1
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Selected protocol dash; container: mp4
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: analyzing media item 196176
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): Direct Play is disabled
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): media must be transcoded in order to use the dash protocol
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no direct play video profile exists for http/mkv/hevc
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no direct play video profile exists for http/mkv/hevc/ac3
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Where There's a Will, There's a Tony (2) - video.bitDepth limitation applies: 10 > 8
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no remuxable profile found, so video stream will be transcoded
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Cannot direct stream video stream due to profile or setting limitations
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Cannot direct stream audio stream due to codec ac3 when profile only allows aac
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Night Court - S8 E24 - Where There's a Will, There's a Tony (2): selected media 0 / 196176
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Streaming Resource: Required bandwidth unknown (media requires deep analysis) Changing decision parameters provided by client to fit bandwidth limit of 115200kbps
Jul 01, 2023 20:31:29.701 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Streaming Resource: Determining preferred transcode encoders through transcode only decision.
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Streaming Resource: Reducing playback quality for 109714kbps stream bitrate: video resolution to 704x528, audio channels to 2, quality to 99
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Selected protocol dash; container: mp4
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: analyzing media item 196176
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): Direct Play is disabled
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): media must be transcoded in order to use the dash protocol
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no direct play video profile exists for http/mkv/hevc
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no direct play video profile exists for http/mkv/hevc/ac3
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Where There's a Will, There's a Tony (2) - video.bitDepth limitation applies: 10 > 8
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: E24 - Where There's a Will, There's a Tony (2): no remuxable profile found, so video stream will be transcoded
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Cannot direct stream video stream due to profile or setting limitations
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: testing hevc (decoder) with hwdevice vaapi
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: testing API vaapi for device '' ()
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Codecs: hardware transcoding: opening hw device failed - probably not supported by this system, error: Generic error in an external library
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Could not create hardware context for hevc
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Cannot direct stream audio stream due to codec ac3 when profile only allows aac
Jul 01, 2023 20:31:29.702 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] MDE: Night Court - S8 E24 - Where There's a Will, There's a Tony (2): selected media 0 / 196176
Jul 01, 2023 20:31:29.703 [0x80f520e00] DEBUG - [Req#12d96c/Transcode] Streaming Resource: Reached Decision id=152029 codes=(General=2000,Neither direct play nor conversion is available. Direct Play=3000,App cannot direct play this item. Direct play is disabled. Transcode=4002,Not enough CPU for conversion of this item.)
2

It’s not just that it’s 10-bit. I converted some 10-bit HEVC down to 8-bit colour, and now I’m getting

Jul 01, 2023 23:47:42.143 [0x8086f4d00] DEBUG - [Req#142d4d/Transcode] To Sleep, No More - video.bitrate limitation applies: 4469 > 3706

I have no bitrate limit set, and besides which, this is a local stream. So something is seriously wrong with the transcoder.

3

Rolling back to 1.32.4.7164 solves the issue, so it’s something between that and 1.32.5.7210.

4

Unfortunately transcoding support was removed from FreeBSB. There is a thread about it: https://forums.plex.tv/t/1-32-2-7002-86cfcc10c-intel-hardware-transcoding-removed-on-freebsd

I myself am considering upgrading to TrueNAS Scale, but it is Linux, yuk.

5

Yes, I am aware that Hardware transcoding was removed. But this machine and setup (Dual Xeon X5677 's) never had hardware transcoding, it was/is only ever software transcoding.

It seems something in 1.32.5.7210 has introduced restrictions on what can be software transcoded, which my machine could previously handle just fine.

I have seen some reports of BHyve PCIe passthrough working for iGPUs and NVidia cards under Linux guests (though not Windows ones), so you could keep CORE and host your Plex in a VM passing through the device you’re using for hardware transcoding, but that’s beyond the scope of this bug report.

6

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.