Plex Media Server upgrade to 1.19.1.2630 won't restart

Server Version#: 1.18.9.2578
Player Version#: N/A

CentOS 7.3.10

Running headless in a CentOS VM for months. Went from 1.13.6.5339 to 1.19.1.2630. Seems like everything updated OK, and when the service fires up, the service just dies and crashes within seconds. Any clues what went wrong? I have many crash dumps if that would be of use to anyone.

systemctl status plexmediaserver

Loaded: loaded (/usr/lib/systemd/system/plexmediaserver.service; enabled; vendor preset: disabled)
Active: deactivating (stop-sigterm) (Result: signal) since Tue 2020-04-07 18:14:02 CDT; 24s ago
Process: 4450 ExecStart=/bin/sh -c PLEX_MEDIA_SERVER_INFO_VENDOR="(grep ^NAME= /etc/os-release | awk -F= "{print \$2}" | tr -d \" )" PLEX_MEDIA_SERVER_INFO_DEVICE="PC" PLEX_MEDIA_SERVER_INFO_MODEL="(uname -m)" PLEX_MEDIA_SERVER_INFO_PLATFORM_VERSION="(grep ^VERSION= /etc/os-release | awk -F= "{print \$2}" | tr -d \" )" LD_LIBRARY_PATH=/usr/lib/plexmediaserver/lib "/usr/lib/plexmediaserver/Plex Media Server" (code=killed, signal=SEGV) Process: 4447 ExecStartPre=/bin/sh -c /usr/bin/test -d "{PLEX_MEDIA_SERVER_APPLICATION_SUPPORT_DIR}" || /bin/mkdir -p “${PLEX_MEDIA_SERVER_APPLICATION_SUPPORT_DIR}” (code=exited, status=0/SUCCESS)
Main PID: 4450 (code=killed, signal=SEGV)
CGroup: /system.slice/plexmediaserver.service
├─4476 Plex Plug-in [com.plexapp.system] /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Framework.bundle/Contents/Resources/Versions/2/Python/bootstrap.py --server-version 1.19.1.2630-72c16a276 /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/System.bundle
├─4533 /usr/lib/plexmediaserver/Plex Tuner Service /usr/lib/plexmediaserver/Resources/Tuner/Private /usr/lib/plexmediaserver/Resources/Tuner/Shared 1.19.1.2630-72c16a276 32600 /waitmutex
├─4564 Plex Plug-in [com.plexapp.agents.fanarttv] /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Framework.bundle/Contents/Resources/Versions/2/Python/bootstrap.py --server-version 1.19.1.2630-72c16a276 /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Fanart-TV.bundle
├─4567 Plex Plug-in [com.plexapp.agents.htbackdrops] /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Framework.bundle/Contents/Resources/Versions/2/Python/bootstrap.py --server-version 1.19.1.2630-72c16a276 /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/HTbackdrops.bundle
└─4568 Plex Plug-in [com.plexapp.agents.lastfm] /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Framework.bundle/Contents/Resources/Versions/2/Python/bootstrap.py --server-version 1.19.1.2630-72c16a276 /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/LastFM.bundle

Apr 07 18:13:52 localhost.localdomain systemd[1]: plexmediaserver.service holdoff time over, scheduling restart.
Apr 07 18:13:52 localhost.localdomain systemd[1]: Stopped Plex Media Server.
Apr 07 18:13:52 localhost.localdomain systemd[1]: Starting Plex Media Server...
Apr 07 18:13:52 localhost.localdomain systemd[1]: Started Plex Media Server.
Apr 07 18:14:02 localhost.localdomain sh[4450]: ****** PLEX MEDIA SERVER CRASHED, CRASH REPORT WRITTEN: /var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Crash Reports/1.19.1.2630-72c16a276/PLEX MEDIA SERVER/3a1bb1d1-2ebc-fcaa-394f073d-47a6fb6e.dmp
Apr 07 18:14:02 localhost.localdomain systemd[1]: plexmediaserver.service: main process exited, code=killed, status=11/SEGV

Plex Media Server logs are surprisingly quiet:

Apr 07, 2020 18:11:02.479 [0x7f379a663700] INFO - Plex Media Server v1.19.1.2630-72c16a276 - CentOS Linux PC x86_64 - build: linux-x86_64 redhat - GMT -05:00
Apr 07, 2020 18:11:02.479 [0x7f379a663700] INFO - Linux version: 7 (Core), language: en-US
Apr 07, 2020 18:11:02.479 [0x7f379a663700] INFO - Processor AMD FX(tm)-8350 Eight-Core Processor           
Apr 07, 2020 18:11:02.479 [0x7f379a663700] INFO - /usr/lib/plexmediaserver/Plex Media Server
Apr 07, 2020 18:11:02.472 [0x7f37aa20c780] INFO - SQLITE3:(nil), 283, recovered 466 frames from WAL file /var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Databases/com.plexapp.plugins.library.db-wal
Apr 07, 2020 18:11:02.847 [0x7f37aa20c780] INFO - SQLITE3:(nil), 283, recovered 6 frames from WAL file /var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Databases/com.plexapp.plugins.library.blobs.db-wal
Apr 07, 2020 18:11:02.901 [0x7f37aa20c780] INFO - OCSP: Successfully retrieved response from cache.
Apr 07, 2020 18:11:04.023 [0x7f3799e62700] WARN - Timed out waiting for server to finish.
Apr 07, 2020 18:11:13.969 [0x7f3799e62700] WARN - JobManager: Could not find job for handle 11318

Thanks,
Erik Coleman

I suppose it might be helpful for @ChuckPa if you can re-run the installation and post the output from your terminal (either as text or screenshot).

Also please post the contents of /tmp/plexinstaller.log ?

Regarding logs being quiet, was DEBUG logging disabled? (turning DEBUG off does not save space)

just applied the update and had the same issue on Linux Mint. Plex Media will not restart

1 Like

Again I ask.

Contents of /tmp/plexinstaller.log and/or the actual console output from when it installed please?

/tmp/pms-8c6bca34-82a0-430a-a666-765b5a8a68c8/ file is empty

Please rerun the installer. You will not harm anything,
Immediately thereafter, without rebooting. grab the file /tmp/plexinstaller.log
along with any console output.

The console output and the contents of /tmp.plexinstaller.log should match.

You know I have never had to “re-run” an installer, I always just do “sudo yum update plexmediaserver”. So when I run that again, all I get is “No Packages Marked for Update”. If I try to do “sudo yum install plexmediaserver” I just get “Nothing to Do”. Is there a way to force the Plex installer inside the RPM to run by itself?

Thanks,
Erik

Now I understand the disconnect. You’re using RPM packaging.
I’m working on that now to follow what I just completed for Debian.

In that RPM , the new installer will run and perform both the validation as well as reporting back to you everything it found and how PMS is setup.

At this point, with us in sync, may I have a tar.gz of the Logs directory (under /var/lib/plexmediaserver a bit)

OK Here’s what I got…
eccoleman-logs.tar.gz (390.5 KB)

Also to answer your previous inquiries, I do have DEBUG turned off at the moment, and unfortunately, I rebooted the system before I was able to grab /tmp/plexinstaller.log.

Thanks,
Erik

Would you mind manually editing the Preferences.xml file?
Doing so allows us to turn DEBUG logging on again

  1. /var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Preferences.xml

  2. Right before the closing /> , add logDebug="1" with a space preceding it.

  3. Save and start PMS.

When it starts next, it will start with DEBUG logging. We’ll see a lot more.

What I can see isn’t promising. It looks like a bad installation:

Apr 08, 2020 09:55:41.557 [0x7fc639ffb700] WARN - Request for plug-in [org.musicbrainz.agents.music] but it doesn't exist.
Apr 08, 2020 09:55:41.917 [0x7fc639ffb700] WARN - Request for plug-in [tv.plex.agents.music] but it doesn't exist.

Normal installation puts these in /usr/lib/plexmediaserver with all the other executables and resources.

This implies a bad download or install.

OK done, and new set of logs are uploaded here. eccoleman-logs.tar.gz (409.5 KB)

So taking a different route, would it be safer/cleaner to just save my databases and do an uninstall/reinstall? Haven’t done that before either, but I think if I just do an rpm -e and delete stuff that will freshen everything? Do I need to save anything else besides databases?

Thanks,
Erik

Did you edit Preferences.xml with Plex already stopped?

It looks like you did but the length of the log files is only 23 KB. It should be a few MB by the time it gets going.

Erik,

How many Plug-ins do you have? PMS thinks you have 39! the limit is 10.

Apr 08, 2020 11:22:47.854 [0x7fc2d67fc700] DEBUG - HTTP 200 response from GET http://127.0.0.1:41457/system/agents
Apr 08, 2020 11:22:47.854 [0x7fc2d67fc700] DEBUG - [com.plexapp.system] HTTP reply status 200, with 6761 bytes of content.
Apr 08, 2020 11:22:47.860 [0x7fc2d67fc700] DEBUG - The system knows about 12 agents.
Apr 08, 2020 11:22:47.861 [0x7fc2d67fc700] DEBUG - Waiting for 39 plug-ins to finish starting.
Apr 08, 2020 11:22:47.866 [0x7fc2b1ffb700] DEBUG - Starting plug-in /usr/lib/plexmediaserver/Resources/Plug-ins-72c16a276/Fanart-TV.bundle.
Apr 08, 2020 11:22:47.868 [0x7fc2b1ffb700] DEBUG - Starting file watcher for com.plexapp.agents.fanarttv
Apr 08, 2020 11:22:47.868 [0x7fc2b1ffb700] DEBUG - Plugin: not setting user token for plugin

I did have it stopped, a quick glance showed DEBUG entries, so I figured I was set.

As for plug-ins, I’ve never messed with them, I’ve kept things pretty stock. So I’m surprised to see that!

-Erik

Would you please go count the number of entries in your Plug-ins directory?
ls -la would be most helpful.

Here’s what I got… neither 10 nor 39:

total 8
drwxr-xr-x. 23 plex plex 4096 Dec 15  2018 .
drwxr-xr-x. 13 plex plex 4096 Apr  8 12:17 ..
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 ABC.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 Break.com.bundle
drwxr-xr-x.  3 plex plex   22 Oct 10  2018 CBS.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 CNET.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 Comedy Central.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 Disney.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 FOX.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 HGTV.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 History Channel.bundle
drwxr-xr-x.  3 plex plex   39 Aug 25  2018 National Geographic.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 NBC.bundle
drwxr-xr-x.  3 plex plex   22 Sep  5  2018 NFL.bundle
drwxr-xr-x.  3 plex plex   22 Aug 27  2018 Plex Podcast.bundle
drwxr-xr-x.  3 plex plex   22 Aug 27  2018 Reddit Videos.bundle
drwxr-xr-x.  3 plex plex   22 Dec 15  2018 Services.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 South Park.bundle
drwxr-xr-x.  3 plex plex   22 Aug 27  2018 Tested.bundle
drwxr-xr-x.  3 plex plex   22 Oct 10  2018 The CW.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 TVLand.bundle
drwxr-xr-x.  3 plex plex   22 Aug 27  2018 Twitch.bundle
drwxr-xr-x.  3 plex plex   22 Aug 25  2018 USA Network.bundle

Honestly, none of those look terribly important, we don’t use those channels via Plex at all.

Thanks,
Erik

Well… you do know there’s no way to access those which stream content anymore and can be removed?

OK So I cleaned up nearly everything in the Plug-Ins folder. There are a few generic ones in there, but seems like it still is crashing as a new log is rotating about every 2 minutes. Here’s the latest batch. eccoleman-logs.tar.gz (401.8 KB)

Thanks,
Erik