Server crashing after latest update to 1.15.0 - Logs included

[sa2000]

@captdeemo

I am having the same issues where plex crashes between 1am-5am… I thought it was the scheduled tasks so i moved them to 9a-1pm… it still crashes randomly…
I updated the latest beta last night this morning it crashed about 445 (I have tautulli that shows the time something last played)

Yours is a Mac so would be interesting to see what crash you get - the windows crashes that are yet to be resolved have been stack buffer overruns.

You appear to have disabled debug logging. So first thing to do is enable debug logging in server general settings / advanced

Then restart the server so we have fresh set of logs created

You mentioned you moved scheduled tasks from 1am-5am to 9am-1pm. Did the crashes move to the new period?

With the debug logging enabled and having restarted the server, wait for next crash on 1.15.1.707 and then restart the server and download the logs - see https://support.plex.tv/articles/200250417-plex-media-server-log-files/

Also look within these areas for any crash reports

Use the Finder’s Go menu, select Go To Folder… then enter the following in the dialog box that pops up:

~/Library/Application Support/Plex Media Server/Crash Reports/1.15.1.707-d893009fb/PLEX MEDIA SERVER

and also look within the MacOS diagnostics areas

~/Library/Logs/CrashReporter/
~/Library/Logs/DiagnosticReports/

[sa2000]

@mcrommert

installed when it released - had a crash at 1 am

Definitely isn’t as bad as the old version but definitely going down

I believe mine went down at scheduled tasks also

Logs please - because crash reports are not being generated for the Stack Buffer Overrun crashes there is no indication as to how widespread the issue. So would like to see logs and for windows export of the Application Event Log as per my post here

for windows

Server crashing after latest update to 1.15.0 - Logs included

The more examples I see of the crashes the better. So please logs with debug logging enabled beforehand and logs downloaded after restarting following a crash together with export of Windows Application Event Log export of all Event IDs 1000 and 1001 and giving me the date and time of either the last or first exported event

for mac

Server crashing after latest update to 1.15.0 - Logs included

Yours is a Mac so would be interesting to see what crash you get - the windows crashes that are yet to be resolved have been stack buffer overruns. You appear to have disabled debug logging. So first thing to do is enable debug logging in server general settings / advanced Then restart the server so we have fresh set of logs created You mentioned you moved scheduled tasks from 1am-5am to 9am-1pm. Did the crashes move to the new period? With the debug logging enabled and having restarted the…

[wyldemusick]

Depending on what happens with 1.15.1.707, this might be my last post in this topic (I’m currently updating BearcubII as well.)

Something seems to be choking the library updates here, but I have no idea what – Audiobooks got stuck, the Suef*etc directory got stuck, Classical I got stuck. I ran a library optimize, no effect.

Here’s the logs, maybe you can see something.Bearcub II PMS logs 2-20 to 2-21.zip (3.2 MB)

[sa2000]

@wyldemusick

Here’s the logs,

You missed Plex Media Server.log when zipping. Perhaps you zipped in-situ rather than copying the files out and then zipping the copy If you zip in-site any open files would get skipped

[wyldemusick]

“It’s a fair cop, guv’nor, yer pinched me red-'anded, yer did!” I did indeed, and thought I’d corrected…seems not!

Alrighty, here’s the rest of the evidence (log.2, I think) and later – the unnumbered log should be the first of the 707, but then again…

The PMS Logs The Log Lady Missed (BearcubII).zip (1000.5 KB)

As for the libraries…well, as I’m on 707, I’ll go over there to mutter about that.

[sa2000]

@wyldemusick

Something seems to be choking the library updates here, but I have no idea what – Audiobooks got stuck, the Suef*etc directory got stuck, Classical I got stuck. I ran a library optimize, no effect

OK - I don’t need the rest of the logs

We appear to have hit a limit on the Gracenote queries database

Feb 21, 2019 01:41:37.708 [6300] ERROR - SQLITE3:0x9ae26860, 13, statement aborts at 20: [INSERT OR REPLACE INTO gnsdk_queries ("key","value","timestamp") VALUES(?,?,?);] database or disk is full
Feb 21, 2019 01:41:37.709 [6300] ERROR - SQLITE3:0x9ae26860, 1, statement aborts at 1: [COMMIT;] cannot commit - no transaction is active
Feb 21, 2019 01:41:37.950 [7276] ERROR - SQLITE3:0x9ae26860, 262, statement aborts at 25: [INSERT OR REPLACE INTO gnsdk_queries ("key","value","timestamp") VALUES(?,?,?);] database table is locked: gnsdk_queries

Feb 21, 2019 01:44:59.657 [7276] ERROR - SQLITE3:0x9ae26860, 262, statement aborts at 24: [INSERT OR REPLACE INTO gnsdk_queries ("key","value","timestamp") VALUES(?,?,?);] database table is locked

Feb 21, 2019 01:45:02.946 [7276] ERROR - SQLITE3:0x9ae26860, 13, statement aborts at 20: [INSERT OR REPLACE INTO gnsdk_queries ("key","value","timestamp") VALUES(?,?,?);] database or disk is full

I don’t know if this is due to the size of the libraries but you could try to get the cache databases recreated

• Shut down Plex Media Server
• Rename the Gracenote cache database files in folder C:\Users\David\AppData\Local\Plex Media Server\Cache
  The files are

gn_cachq.gdb
gn_colls.gdb
gn_lists.gdb

With the files renamed eg gn_cachq.gdb.saved then launch Plex Media Server and refresh the Audiobooks and Classicall I libraries - these database files will get recreated

[wyldemusick]

I just deleted Classical I and combined it with Classical II, so they’re updating right now. The database optimized again on the deletion.

However, I’ll go ahead and shut down and take these steps just to be on the safe side. Interesting that there seems to be a limit on the queries.

[_JOHN]

If you watch it, as soon as it does a library optimize/clean up it crashes.

[wyldemusick]

This version? Or 1.15.1.659? This specific version wasn’t an issue for me, aside from the Database stickiness caused by Gracenote.

If it’s 1.15.. in question, that topic is here: Server crashing after latest update to 1.15.0 - Logs included

[sa2000]

@wyldemusick for the 2nd time I moved posts and dialogue concerning 1.15..x from the 1.14.1.5488 topic PMS 1.14.1.5488 Crashing frequently on Windows
It makes it very hard when some replies to you are here and others are in different thread. Stick to one please so we have all the issues regarding crashes and scanning stuck here

Bearcubll

@wyldemusick

BearcubII went down during the night, after I stopped Classical’s library scan and let it move to Classical II, which also thrashed without seeming to do much of anything. Looking at the Task Manager, the Plex Media Scanner was still up (though I’d had a crash alert saying it had stopped), the usual Plex Script Host entries, and…Plex Transcoder, sucking up 48% of the CPU cycles. Not sure why it was thrashing like that, but I suspect something in Zmisc tried to eat it.

@wyldemusick

BearcubII is still working on the consolidated Classical library, not sure if it’s stuck with the Gracenote database again – the last time I built a big library, though, it took a while.

@wyldemusick

And in case I do have the sticky library thing again, here’s logs for BearcubII as well

@wyldemusick

707 just crashed quietly on BearcubII. Interesting to me is that I was having it scan the BBC Classic library after I moved a folder from Classical to BBC Classical (where it really belonged.) It appeared to have gotten stuck scanning what is a small library, and then it quietly expired.

The only uploaded crash reports are those that were in 1.15.0.659 and fixed in 1.15.1.707

Would like an export of the Windows Application event log (filtered on Event ID 1000 and 1001 to see when the crash occurred and what type of crash - please let me know the date and time of either the last or first exported event. Best to export to evtx file

With regards to Gracenote searching for the Premium Music Library, there are still errors - logged Feb 22 between 01:25 and 01:58

Feb 22, 2019 01:25:13.663 [7428] ERROR - SQLITE3:0xa9a30178, 13, statement aborts at 19: [INSERT OR REPLACE INTO gnsdk_queries ("key","value","timestamp") VALUES(?,?,?);] database or disk is full

Did you go through deleting the cache gracenote databases .gdb files ?
If you did and it is still happening, copy the gdb files out, zip the copy and send it to me to have a look

Brainbuntu

@wyldemusick

Well, sadly enough I woke up to one crashed server – Brainbuntu ■■■■ the bed during the morning.

Logs for Brain attached. I haven’t even had my morning cuppa, yet (and I’m wishing I had hot chocolate, as we had a minor blizzard here in Tucson.)

@wyldemusick

Brainbuntu just crashed, right on time – seems to have gone down right after scheduled tasks started at 2am

(Edit to add: as soon as the logs were downloaded, down it went again. I’m turning scheduled tasks off.)

Over at Brainbuntu, meanwhile, things are presently stuck, again, on the Classical library (the consolidated one.) This may just be slow motion grrrrriiiiinnnnndddddding through, though after twelve hours of nothing happening, I’m getting antsy.

Would like an export of the Windows Application event log (filtered on Event ID 1000 and 1001 to see when the crash occurred and what type of crash - please let me know the date and time of either the last or first exported event. Best to export to evtx file

[wyldemusick]

Apparently I’m getting REALLY confused somewhere in here, as I thought I was posting about 1.14 on BearcubII (now upgraded) over there – which one of those replies specifically references, as it includes a link to here – and about 1.15.1.x over here. I need better drugs. No, seriously, I do; I’m unmedicated ADHD.

[wyldemusick]

And, yes, I’ve gone through deleting the Gracenote cache files…twice so far. The last time I just moved them elsewhere. I’m right now doing a database optimization (due to consolidating the libraries, and having a crash gave me room to get that started. When it’s finished, I’ll shut down and do it a third time.)

As to the crash, that happened while I was initially running the database optimization. I’ll go get etvx files, but here’s the logs and a text version from the event viewer (it’s a little harder from Bearcub, as it’s awkwardly set up.)

Plex Media Server Logs_2019-02-24_23-16-28.zip (7.5 MB)

Plex Event Viewer Log 02-21 to 02-24.zip (56.1 KB)

Event Viewer Log 02-24.txt (1.7 KB)

I hope I got the event viewer setup right, and got the files properly exported. It reopened OK in the event viewer…hurgh. I used to do this for a living, before I got sensible.

Oh, and the latest crash was tonight at 9.43pm (I think), not discovered until 10:45pm or thereabouts. Once again it was just PMS itself that crashed – the Media Scanner was still showing as up, the Transcoder was again at 45% of CPU, and the usual happy mob of PlexScriptHost entries needed to be manually killed, yet again. I’ll be very surprised if there’s any sign of a crash log upload, honestly.

[mcrommert]

I’m getting a crash every night/early morning - saturday and sunday it was during scheduled tasks…was later today…hope the logs helpPlex Media Server Logs_2019-02-25_10-01-12.zip (4.9 MB)

[wyldemusick]

Once again stuck at the Classical I library on a scan. It looks like it scanned through the Classical I folder and then stuck before going on to Classical II. Plus, Plex Transcoder is at 50% CPU this time.

I’ve stopped the scan of Classical I and let it move on to what is now Classical II (which finished properly the last time it was run.) Let’s see where else it gets stuck.

I’ll zip up the .gdb files, meanwhile.

Plex Media Server Logs_2019-02-25_09-25-05.zip (7.1 MB)

[wyldemusick]

Huh, this is new (to me) – Plex Transcoder crashed multiple times while scanning the newly added HD audio library. Which I think I shall remove…I set it up once before and it didn’t work right because I wasn’t getting proper pass-through and 5.1 files kept coming out as PCM stereo at 44.1/16.

Plex Media Server Logs_2019-02-25_09-45-19.zip (7.0 MB)

Edited to add: Just stopped the scan of the HD library, and tried playing a track. Plex Media Scanner proceeded to crash multiple times. I’m currently deleting that library, so I’ll have to get the logs after it’s done optimizing.

[wyldemusick]

Installing 1.151.710 on Brainbuntu, but here’s the logs for that server just prior to the new installation. This is after deleting the second Anime (Movie) library that popped up and optimizing the database automatically as a result.

Plex Media (6.7 MB)

Edited to add a post-*710 install log, as there was some odd behaviour – first it tried to get me to update it again to 710, after insisting that I was updating to 707 before, and then it wouldn’t show the server settings; I shut Plex down (with exit) and restarted, and it went back to normal.

Plex Media (5.1 MB)

Edit: Uh oh. The server on BearcubII (which I just updated to 710 as well) isn’t loading properly. This is right in keeping with before I did the update, when it semi-crashed during database optimization (it was showing in Task Manager, but inaccessible.)

Let me see if I can get the logs, and I’ll see about getting a copy of the database up as well.

PMS Bearcub II Logs 02-25.zip (10.7 MB)

[captdeemo]

crashes moved to later (3-5 am) but still crashed , I enabled debug and will post if it happens tonight.
thank you

[wyldemusick]

I’m running a library update on BearcubII…so far it’s sailed through everything up to Classical I, where it’s sitting, and has sat for two and a half hours…if this goes long enough, I’ll delete the library, let Plex optimize the database, and try starting clean.

It’s about to get slightly tricky…I have to shut down at some point soon and move things around so I can take down the old desk.

[wyldemusick]

Aaaaand…the transcoder on BearcubII is banging away at 50% of CPU yet again, while nothing is happening with that Classical I directory.

[captdeemo]

update… had it crash where i could not access plex on the server for 8 minute (2016-2024) 2/25 .
i’ve uploaded the plex log… i changed my username and media paths that is it.

nothing in system logs during that time… both the crash reports folders had nothing written.Plex Media Server.zip (344.1 KB)