Linux Packaging - Developer's Sandbox - HDR tonemapping packaging support

riiviin · April 22, 2021, 9:37pm

I am specifically referring to the “4163 regression”.

ChuckPa · April 22, 2021, 10:37pm

They’ve all told me the regression which happened after 4163 is released in PlexPass today.

I’ve seen the QA reports.

Was something missed and can you capture please in the DEBUG logs so I can go back over them?

Functional question: Are you letting it play normally -OR- are you “seeking” during playback.

Seeking during Playback problem is still open. That fix is not yet complete & released.

emb531 · April 23, 2021, 1:23am

There was no PlexPass version released today - 1.22.3.4392 moved to Public however.

The regression @riiviin and I are experiencing is lack of HW transcoding for HDR → SDR (which has been broken since 1.22.0.4163 and remains broken).

There are other complaints around regarding 11th gen HW transcoding issues, which as you allude to are likely kernel/driver related as those processors are still brand new.

Our 10th gen’s worked perfectly for HW HDR → SDR until versions post 1.22.0.4163.

Once you are able to get on the NUC10 and do some testing you will see what we mean.

ChuckPa · April 23, 2021, 1:55am

I took the logs from @riiviin and forward to both the team member and director telling them both this is not fixed as claimed.

The NUC is in the lab.

The OS currently loaded on it is being replaced with Ubuntu 20.04.2 LTS so I can capture and demonstrate this myself which affords engineering with a system they can touch and use to fix

ChuckPa · April 23, 2021, 8:57pm

I got more time to work on this today and refine it.

OpenCL is required if either Beignet or IntelComputeRuntime is used
Reworked processor detection logic.

We shouldn’t have any more of the CPUSKU problems previously encountered.

I would appreciate a few folks with AMD, Xeon, and Intel -9xxx or higher giving this a quick run and providing feedback letting me know if it’s correctly surveyed the machine and installed libraries (HDR related)

It’s just the preinstall script.

It will generate /tmp/plexinstaller.log file which reports what was found and what’s needed during actual installation & configuration.

Fixed – below

emb531 · April 23, 2021, 10:06pm

# Plex Media Server installation configuration info:  Fri 23 Apr 2021 06:03:49 PM EDTplexmediaserver_1.22.3.4392-d7c624def_amd64.deb
LangEncoding="en_US.UTF-8"
ExistingVersion=12200
HaveHardware=1
HaveTranscoderPref=1
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=0
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=1
HaveNvidia=0
Processor=i5-10600K
CPUSKU=10600
NeedBeignet=0
NeedIntelCompute=1
HaveIntelGmmlib=1
HaveIntelIGCCore=1
HaveIntelIGCOpenCL=1
HaveIntelOpenCL=1
HaveIntelOCLoc=1
HaveIntelZeroGPU=1
HaveIntelCompute=1
HaveBeignet=0
HaveOpenCL=1
Platform="System Product Name"
Processor="i5-10600K"
Distro="Ubuntu 20.04.2 LTS"
Kernel="Linux Saturn 5.8.0-50-generic #56~20.04.1-Ubuntu SMP Mon Apr 12 21:46:35 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux"
Memory=""

Looks good, though “Memory” did not return any result. Did you experience the lack of HW HDR → SDR on the NUC10?

anon5074910 · April 23, 2021, 10:15pm

Ubuntu 20.04.2 LTS
CPU: Intel i7-9750H
GPU: NVIDIA GeForce RTX 2080 Mobile

plexinstaller.log (774 Bytes)

ChuckPa · April 23, 2021, 10:37pm

Thank you both.

I see where I lost that in the overhaul.
Fixed now.

ChuckPa-preinst.zip (8.8 KB)

chuck@plexdev:~/git/postprocessor/targets/debian/files/debian$ ./ChuckPa-preinst.sh 
rm: cannot remove '/tmp/plexinstaller.log': Operation not permitted
chuck@plexdev:~/git/postprocessor/targets/debian/files/debian$ sudo !!
sudo ./ChuckPa-preinst.sh 
PlexMediaServer install: Pre-installation Validation.
PlexMediaServer install: Warning:  Multiple override files found. PMS may not function as expected.
PlexMediaServer install:           Files found are:  Another.conf override.conf
PlexMediaServer install:           Selected: "override.conf".
PlexMediaServer install: Warning:  "/var/lib/plexmediaserver/Library/Application Support" isn't owned by "plex", UID: 998.  Found "UNKNOWN", UID: 12345 instead. Continuing.
PlexMediaServer install: Pre-installation Validation complete.  Errors: 0, Warnings: 2
chuck@plexdev:~/git/postprocessor/targets/debian/files/debian$ cat /tmp/plexinstaller.log 
# Plex Media Server installation configuration info:  Fri Apr 23 18:38:49 EDT 2021plexmediaserver_1.22.3.4392-d7c624def_amd64.deb
LangEncoding="en_US.UTF-8"
ExistingVersion=12203
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=2
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=0
HaveNvidia=0
Processor=i7-8809G
CPUSKU=0
NeedBeignet=0
NeedIntelCompute=0
HaveIntelGmmlib=0
HaveIntelIGCCore=0
HaveIntelIGCOpenCL=0
HaveIntelOpenCL=0
HaveIntelOCLoc=0
HaveIntelZeroGPU=0
HaveIntelCompute=0
HaveBeignet=0
HaveOpenCL=0
Platform="VMware Virtual Platform"
Processor="i7-8809G"
Distro="Ubuntu 18.04.2 LTS"
Kernel="Linux plexdev 4.15.0-45-generic #48-Ubuntu SMP Tue Jan 29 16:28:13 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux"
Memory="3921 1035 717"
chuck@plexdev:~/git/postprocessor/targets/debian/files/debian$

Be advised:

If in a VM and no i915 enumerated, CPUSKU = 0.

riiviin · April 23, 2021, 10:39pm

# Plex Media Server installation configuration info:  Fri 23 Apr 2021 05:39:00 PM CDTplexmediaserver_1.22.3.4392-d7c624def_amd64.deb
LangEncoding="en_US.UTF-8"
ExistingVersion=12200
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=0
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=1
HaveNvidia=0
Processor=i7-10710U
CPUSKU=10710
NeedBeignet=0
NeedIntelCompute=1
HaveIntelGmmlib=1
HaveIntelIGCCore=1
HaveIntelIGCOpenCL=1
HaveIntelOpenCL=1
HaveIntelOCLoc=1
HaveIntelZeroGPU=1
HaveIntelCompute=1
HaveBeignet=0
HaveOpenCL=0
Platform="NUC10i7FNH"
Processor="i7-10710U"
Distro="Ubuntu 20.04.2 LTS"
Kernel="Linux nuc 5.11.14-051114-generic #202104140732 SMP Wed Apr 14 07:55:50 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux"
Memory="31820 1477 1290"

ChuckPa · April 23, 2021, 10:43pm

Now we’re cookin’

ChuckPa · April 23, 2021, 10:46pm

@riiviin

You should find that if you install ocl-icd-opencl1, it will stop complaining about OpenCL.

ChuckPa · April 24, 2021, 12:06am

This is experimental:

New packaging for Comet and RocketLake CPUs
Proposed PMS transcoder changes
Other miscellaneous breakages

This is NOT FOR PRODUCTION USE - NOT QA TESTED - WORK IN PROGRESS

GOALS:

Proper detection of:
a. CPU
b. Type of HDR support needed: Beignet or Intel Compute Runtime
Fully & Correctly populated plexinstaller.log
If we’re lucky, a working transcoder capable of pre 1.22.0.4163 capabilities + more

anon5074910 · April 24, 2021, 8:26am

Ran your updated script and below is my log

plexinstaller.log (789 Bytes)

Still seeing CPUSKU=0 but not sure if that is a problem or not based on my system and the fact I have a dedicated GPU.

timstephens24 · April 24, 2021, 12:42pm

Still no hardware transcode for HDR to SDR.

PlexMediaServer install: PlexMediaServer-1.23.0.4412-9b095e06b - Installation starting.
PlexMediaServer install:
PlexMediaServer install: Now installing based on:
PlexMediaServer install:   Installation Type:   Update
PlexMediaServer install:   Process Control:     systemd
PlexMediaServer install:   Plex User:           timstephens24
PlexMediaServer install:   Plex Group:          timstephens24
PlexMediaServer install:   Video Group:         render
PlexMediaServer install:   Metadata Dir:        /var/lib/plexmediaserver/Library/Application Support
PlexMediaServer install:   Temp Directory:      /tmp
PlexMediaServer install:   Lang Encoding:       en_US.UTF-8
PlexMediaServer install:   Config file used:    /etc/systemd/system/plexmediaserver.service.d/override.conf
PlexMediaServer install:   Intel QSV Hardware:  Found
PlexMediaServer install:   Nvidia GPU card:     Not Found
PlexMediaServer install:
PlexMediaServer install:   OpenCL library:      Installed
PlexMediaServer install:   Beignet package:     Installed
PlexMediaServer install:
PlexMediaServer install: Completing final configuration.
PlexMediaServer install: Starting Plex Media Server.
PlexMediaServer install: PlexMediaServer-1.23.0.4412-9b095e06b - Installation successful.  Errors: 0, Warnings: 0
# Plex Media Server installation configuration info:  Sat Apr 24 08:44:37 AM EDT 2021
Init=0
Systemd=1
Custom=0
LinuxContainer=0
NewInstall=0
HaveOverride=1
OverrideFile="/etc/systemd/system/plexmediaserver.service.d/override.conf"
PlexUser="timstephens24"
PlexGroup="timstephens24"
VideoGroup="render"
AppSuppDir="/var/lib/plexmediaserver/Library/Application Support"
PlexTempDir="/tmp"
LangEncoding="en_US.UTF-8"
ExistingVersion=12200
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=1
Errors=0
Warnings=0
Havei915=1
HaveNvidia=0
HaveBeignet=1
HaveOpenCL=1
Platform="Z490 VISION D"
Processor="Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz"
Distro="Ubuntu 20.10"
Kernel="Linux zeus 5.8.0-50-generic #56-Ubuntu SMP Mon Apr 12 17:18:36 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux"
Memory="64162 5728 1798"

ChuckPa · April 24, 2021, 2:10pm

@timstephens24

Look at your plexinstaller.log. There’s something really bad here. You don’t even have all the flags

chuck@plexdev:~/git/postprocessor$ cat /tmp/plexinstaller.log 
# Plex Media Server installation configuration info:  Sat Apr 24 10:05:52 EDT 2021plexmediaserver_1.22.3.4392-d7c624def_amd64.deb
LangEncoding="en_US.UTF-8"
ExistingVersion=12203
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=2
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=0
HaveNvidia=0
Processor=i7-8809G
CPUSKU=0
NeedBeignet=0
NeedIntelCompute=0
HaveIntelGmmlib=0
HaveIntelIGCCore=0
HaveIntelIGCOpenCL=0
HaveIntelOpenCL=0
HaveIntelOCLoc=0
HaveIntelZeroGPU=0
HaveIntelCompute=0
HaveBeignet=0
HaveOpenCL=0
Platform="VMware Virtual Platform"
Processor="i7-8809G"
Distro="Ubuntu 18.04.2 LTS"
Kernel="Linux plexdev 4.15.0-45-generic #48-Ubuntu SMP Tue Jan 29 16:28:13 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux"
Memory="3921 1075 1023"
chuck@plexdev:~/git/postprocessor$

emb531 · April 24, 2021, 2:37pm

Same results as @timstephens24 with 1.23.0.4412 - no HW HDR → SDR, and also missing flags in plexinstaller.log

# Plex Media Server installation configuration info:  Sat 24 Apr 2021 10:34:24 AM EDT
Init=0
Systemd=1
Custom=0
LinuxContainer=0
NewInstall=0
HaveOverride=0
OverrideFile=""
PlexUser="plex"
PlexGroup="plex"
VideoGroup="video"
AppSuppDir="/var/lib/plexmediaserver/Library/Application Support"
PlexTempDir="/dev/shm"
LangEncoding="en_US.UTF-8"
ExistingVersion=0
HaveHardware=1
HaveTranscoderPref=1
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=1
Errors=0
Warnings=0
Havei915=1
HaveNvidia=0
HaveBeignet=0
HaveOpenCL=1
Platform="System Product Name"
Processor="Intel(R) Core(TM) i5-10600K CPU @ 4.10GHz"
Distro="Ubuntu 20.04.2 LTS"
Kernel="Linux Saturn 5.8.0-50-generic #56~20.04.1-Ubuntu SMP Mon Apr 12 21:46:35 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux"
Memory="31942 1382 14061"

ChuckPa · April 24, 2021, 2:46pm

Binary withdrawn – Too experimental

Please verify a full set of flags in plexinstaller.log

chuck@plexdev:~/git/postprocessor$ cat /tmp/plexinstaller.log 
# Plex Media Server installation configuration info:  Sat Apr 24 10:40:15 EDT 2021
Init=0
Systemd=1
Custom=0
LinuxContainer=0
NewInstall=0
HaveOverride=1
OverrideFile="/etc/systemd/system/plexmediaserver.service.d/override.conf"
PlexUser="plex"
PlexGroup="plex"
VideoGroup="video"
AppSuppDir="/var/lib/plexmediaserver/Library/Application Support"
PlexTempDir="/tmp"
LangEncoding="en_US.UTF-8"
ExistingVersion=12300
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=2
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=0
HaveNvidia=0
Processor=i7-8809G
CPUSKU=8809
NeedOpenCL=0
NeedBeignet=0
NeedIntelCompute=0
HaveIntelGmmlib=0
HaveIntelIGCCore=0
HaveIntelIGCOpenCL=0
HaveIntelOpenCL=0
HaveIntelOCLoc=0
HaveIntelZeroGPU=0
HaveIntelCompute=0
HaveBeignet=0
HaveOpenCL=0
Platform="VMware Virtual Platform"
Processor="i7-8809G"
Distro="Ubuntu 18.04.2 LTS"
Kernel="Linux plexdev 4.15.0-45-generic #48-Ubuntu SMP Tue Jan 29 16:28:13 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux"
Memory="3921 1087 1358"
chuck@plexdev:~/git/postprocessor$

timstephens24 · April 24, 2021, 3:04pm

Here’s what I got:

PlexMediaServer install: Now installing based on:
PlexMediaServer install:   Installation Type:   Update
PlexMediaServer install:   Process Control:     systemd
PlexMediaServer install:   Plex User:           timstephens24
PlexMediaServer install:   Plex Group:          timstephens24
PlexMediaServer install:   Video Group:         render
PlexMediaServer install:   Metadata Dir:        /var/lib/plexmediaserver/Library/Application Support
PlexMediaServer install:   Temp Directory:      /tmp
PlexMediaServer install:   Lang Encoding:       en_US.UTF-8
PlexMediaServer install:   Config file used:    /etc/systemd/system/plexmediaserver.service.d/override.conf
PlexMediaServer install:   Intel i915 Hardware: Found
PlexMediaServer install:   Nvidia GPU card:     Not Found
PlexMediaServer install:
PlexMediaServer install:   OpenCL:              Installed
PlexMediaServer install:   Intel Gmmlib:        Installed
PlexMediaServer install:   Intel IGC Core:      Installed
PlexMediaServer install:   Intel IGC OpenCL:    Installed
PlexMediaServer install:   Intel OpenCL:        Installed
PlexMediaServer install:   Intel OCLoc:         Installed
PlexMediaServer install:   Intel Zero GPU:      Installed
PlexMediaServer install:
PlexMediaServer install: Completing final configuration.
PlexMediaServer install: PlexMediaServer-1.23.0.4412-9b095e06b - Installation successful.  Errors: 0, Warnings: 0
# Plex Media Server installation configuration info:  Sat Apr 24 10:59:47 AM EDT 2021
Init=0
Systemd=1
Custom=0
LinuxContainer=0
NewInstall=0
HaveOverride=1
OverrideFile="/etc/systemd/system/plexmediaserver.service.d/override.conf"
PlexUser="timstephens24"
PlexGroup="timstephens24"
VideoGroup="render"
AppSuppDir="/var/lib/plexmediaserver/Library/Application Support"
PlexTempDir="/tmp"
LangEncoding="en_US.UTF-8"
ExistingVersion=12200
HaveHardware=1
HaveTranscoderPref=0
NeedUser=0
NeedGroup=0
NeedVideo=0
Verbose=1
Running=0
Errors=0
Warnings=0
HaveIntel=1
HaveIntelCore=1
HaveIntelXeon=0
Havei915=1
HaveNvidia=0
Processor=i7-10700K
CPUSKU=10700
NeedOpenCL=1
NeedBeignet=0
NeedIntelCompute=1
HaveIntelGmmlib=1
HaveIntelIGCCore=1
HaveIntelIGCOpenCL=1
HaveIntelOpenCL=1
HaveIntelOCLoc=1
HaveIntelZeroGPU=1
HaveIntelCompute=1
HaveBeignet=1
HaveOpenCL=1
Platform="Z490 VISION D"
Processor="i7-10700K"
Distro="Ubuntu 20.10"
Kernel="Linux zeus 5.8.0-50-generic #56-Ubuntu SMP Mon Apr 12 17:18:36 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux"
Memory="64162 5754 16691"

But that version of Plex isn’t running

Apr 24 11:02:13 zeus systemd[1]: plexmediaserver.service: Main process exited, code=dumped, status=11/SEGV
Apr 24 11:02:13 zeus systemd[1]: plexmediaserver.service: Failed with result 'core-dump'.

ChuckPa · April 24, 2021, 3:06pm

@timstephens24

Please go grab the log files. Let’s see if there’s any indication in there as to why

If you see none, then please invoke manually and check for:

chuck@plexdev:/usr/lib/plexmediaserver$ ./Plex\ Media\ Server 
DCRT: Failed to open ldso
Segmentation fault (core dumped)
chuck@plexdev:/usr/lib/plexmediaserver$

If this is your finding then I will withdraw the above and hold back until a later binary from Engineering before bringing it here.

PMS 1.23.0 will contain the corrections we need for the -10xxx CPUs

timstephens24 · April 24, 2021, 3:15pm

There were no new logs created.

DCRT: Failed to open ldso
[1]    36064 segmentation fault (core dumped)  ./Plex\ Media\ Server

Topic		Replies	Views
PMS Packaging 07-2022 update - Forum Preview & Testing Desktops & Laptops server-linux	134	4051	January 18, 2023
Ubuntu 22.04 Packaging - development & preview Plex Media Server server-linux	171	3322	July 7, 2022
No hardware transcoding in Ubuntu server Plex Media Server server-linux	43	830	June 30, 2021
HW acceleration of intel igp broken after latest upgrade Desktops & Laptops server-linux	19	421	August 21, 2022
[SOLVED] Plex doesnt do HW transcoding on Ubuntu 18.04 with i9-9900 (tone mapping related) Desktops & Laptops server-linux	88	4427	July 6, 2022

Linux Packaging - Developer's Sandbox - HDR tonemapping packaging support

This is experimental:

Related topics