PMS crashing nightly - TVS-871 w/ 32GB of RAM runs out of memory, Chapter Creation

[LovelyCupOfTea]

Server Version#: Version 4.57.4

Hi There,

I have seen a few other topics relating to my issue shown below, basically every night when the scheduled tasks run Plex is stopped by QTS due to excessive memory usage, I am a bit stuck and feel I have tried everything I can try, if it is a bad video file causing this it will be a bit like finding a needle in a haystack!

I have done HBBatchBeast on the library as a health check to try find a corrupted file but its coming back all good.

Its a TVS871 with a 4690K, 32Gb of Memory and 4 x 18Tb Drives in Raid 5 with plenty of space left., I have never had this issue before and have tried for weeks to resolve. I have even completely removed plex and started fresh with a new library twice!

Basically I reckon its something to do with the scheduled tasks that run between 2am and 5am, but for the life of me I cannot figure out what it is or what has changed.

Any help that can be provided would be great, I found the other two threads a bit inconclusive so didn’t know where else to go!

Cheers

QNAP excessive memory usage

Server Version#: 1.20.5.3600 Player Version#: 4.46.2 I was having trouble with my old QNAP server and I thought it might be due to the memory I was using. I upgraded to a QNAP TS-453D with 8Gb factory installed. I still keep getting excessive memory use from Plex and the QNAP kills the process. Warning 2020-11-18 17:45:02 — 127.0.0.1 — --- [System Message] PlexMediaServer has been automatically disabled by QTS to free up system memory.

Windows PMS Crashing EVERY NIGHT please help!

Server Version#: 1.15.1.710 Player Version#: 3.89.1 So I updated to the latest build and it’s crashed twice in the last 24 hours. I’ve uploaded the logs here: http://www.qcomics.net/images/pmslogs_2019-02-27_09-21-58.zip Is there any setting I can change? Help?

[lawriewalters]

I had the same problem. I found that it was because I had some of my library files on USB drives and the drive was not compatible.

[LovelyCupOfTea]

Many Thanks Lawrie, Unfortunately I do not have any external drives attached

[LovelyCupOfTea]

In the error logs shortly before Crash I have this row repeating its self almost 40 times, but I don’t know what file or what specifically this is referring to.

I think its to do with Generating Chapter Thumbs.

Jun 06, 2021 02:35:50.651 [0x7f84f14fab38] ERROR - SSDP: Error parsing device schema for http://192.168.1.1:1990/3c5a2da1-cdba-4f0b-8c48-7529cde246ab/WFADevice.xml
Jun 06, 2021 02:36:23.142 [0x7f84f14fab38] DEBUG - NetworkServiceBrowser: Parsing SSDP schema for http://192.168.1.1:1990/3c5a2da1-cdba-4f0b-8c48-7529cde246ab/WFADevice.xml
Jun 06, 2021 02:36:23.142 [0x7f84f14fab38] DEBUG - HTTP requesting GET http://192.168.1.1:1990/3c5a2da1-cdba-4f0b-8c48-7529cde246ab/WFADevice.xml
Jun 06, 2021 02:36:23.142 [0x7f84f14fab38] ERROR - Error issuing curl_easy_perform(handle): 1
Jun 06, 2021 02:36:23.142 [0x7f84f14fab38] WARN - HTTP error requesting GET http://192.168.1.1:1990/3c5a2da1-cdba-4f0b-8c48-7529cde246ab/WFADevice.xml (1, Unsupported protocol) (Received HTTP/0.9 when not allowed

Before this you see numerous entries for Generating chapter thumbs that have a status of 99.7% or 99.8% the amount of which its out of constantly increases meaning it never gets to 100% then

Jun 06, 2021 02:12:55.395 [0x7f84f3529b38] DEBUG - Jobs: ‘/share/CE_CACHEDEV1_DATA/.qpkg/PlexMediaServer/Plex Media Scanner’ exit code for process 3585 is 0 (success)
Jun 06, 2021 02:12:55.396 [0x7f84f1902b38] DEBUG - Activity: Ended activity ef06fad0-5c38-4304-b6c3-832a4b4b3f04.
Jun 06, 2021 02:12:55.396 [0x7f84f1902b38] DEBUG - Activity: ended sub-activity 67642813-51e2-4c2d-a750-9b4435ef7080 parent: 22eab385-5fb6-41b8-8bb5-67f4499691fd overall progress: 100.0% (335/335)
Jun 06, 2021 02:12:55.396 [0x7f84f1902b38] DEBUG - Activity: updated activity 22eab385-5fb6-41b8-8bb5-67f4499691fd - completed 100.0% - Butler tasks
Jun 06, 2021 02:12:55.396 [0x7f84f1902b38] DEBUG - Activity: registered new sub-activity 99f52ed3-b68b-4930-91ff-4f0ff131c3c4 - “GenerateChapterThumbs” parent: 22eab385-5fb6-41b8-8bb5-67f4499691fd overall progress: 99.7% (335/336)
Jun 06, 2021 02:12:55.396 [0x7f84f1902b38] DEBUG - Activity: updated activity 22eab385-5fb6-41b8-8bb5-67f4499691fd - completed 99.7% - Butler tasks
Jun 06, 2021 02:12:55.397 [0x7f84f1902b38] DEBUG - Activity: registered new activity c4886261-1437-4864-9106-f996765e1a85 - “Generating video chapter thumbnails”
Jun 06, 2021 02:12:55.397 [0x7f84f1902b38] DEBUG - [JobRunner] Job running: FFMPEG_EXTERNAL_LIBS=‘/share/CE_CACHEDEV1_DATA/.qpkg/PlexMediaServer/Library/Plex\ Media\ Server/Codecs/fa235d6-3858-linux-x86_64/’ X_PLEX_TOKEN=‘xxxxxxxxxxxxxxxxxxxx’ ‘/share/CE_CACHEDEV1_DATA/.qpkg/PlexMediaServer/Plex Media Scanner’ ‘–generate’ ‘–chapter-thumbs-only’ ‘–item’ ‘17287’ ‘–log-file-suffix’ ’ Chapter Thumbnails’
Jun 06, 2021 02:12:55.397 [0x7f84f1902b38] DEBUG - [JobRunner] Jobs: Starting child process with pid 3588
Jun 06, 2021 02:12:55.486 [0x7f84f3529b38] VERBOSE - JobManager: child process with handle 3588 exited

How do I identify which file its getting stuck at with chapter thumbnails?

Please see the log files below for the plex media scanner which is recording numerous errors close before the crash at 2:41am I am certain now this is to do with Chapter thumbnails but on a certain faulty file, but I do not know how to find the faulty file, is it item 7070? how do I link this back to a file?

Plex Media Scanner Chapter Thumbnails.4.log (10.0 MB)
Plex Media Scanner Chapter Thumbnails.5.log (10.0 MB)

[LovelyCupOfTea]

So, this turned out to be chapter creation on a corrupt video file.

Should this be addressed that if the chapter creation is taking too long due to a corrupted video file, it throws up a warning or skips it rather than filling the ram up causing QTS to force close plex due to memory usage? Seems that there needs to be a fail safe or fall back for chapter creation coming across a corrupted file.

Is this something the developers can look to resolve? I have removed the faulty video file while maintaining chapter creation in the scheduled tasks and it now works perfectly. No more crashes!

I changed the scheduled tasks during the day then just sat and watched it run as well as memory usage in QTS until it appeared to get stuck on a specific file, this was how I identified the file causing the issue, tried the file in VLC which did not play properly, deleted it and problem was solved.

I hope this helps someone else with the same issue!