Plex media server slow on services despite system resources

Server Version#: Version 1.13.6.5339
Player Version#:

Plex services such as guide, butler, guide etc taking for ever to load or cycle or complete despite system resources.

Also from previous thread
https://forums.plex.tv/t/is-plex-programmed-for-multi-core-processor-usage-and-hyper-threading/208190

With 4.5 full cores in use, demonstrating PMS is multi-threaded, You’ve got something serious going on however to find out what’s actually happening will require DEBUG (VERBOSE turned off) log files

The best I can suggest is verify logging settings the restart it.
If, without doing anything, it is sitting at 450% (4.5 cores), there’s a major issue which needs to be solved first.

I would also like to let you know, if the opportunity presents itself to upgrade from 14.04 to 16.04 or newer, I strongly recommend you do so. You’ll find the libraries are more current and stable because PMS is built with current libraries. Ubuntu 14.04 now represents 5 years in the past.

1 Like

the verbose logging has always been turned off. i’ve attached the latest logs and will have ti check into upgrading as everytime we do its a night mare to get the system and other applications back online after wards. Plex Media (14.7 MB)

There’s a lot of database activity with DVR doing its thing but that isn’t as important as this.

Sep 03, 2018 20:22:17.437 [0x7fa2193ff700] WARN - SLOW QUERY: It took 220.000000 ms to retrieve 1 items.

This indicates the database is becoming fragmented from media insertion or moving. It should be abe to retrieve 200 in 10 ms, not worse than the inverse.

It you hover over Libraries, expose the ellipsis, click it, then click “Optimize Database”, it will re-optimize the DB.

if this does not resolve the issue, we’ll need to look deeper.

Tried that couple of times not helping. still slow to load move and navigate and change priorities page in chrome times out before changes take effect.

Chuck this issue still happening and also others, all screens freezing and taking for ever to load and update even home page. also scanned drive and have 558 files that are less then 200k where videos are recording but not completing or not full length. since the last time i scanned the files last month.

Do you have all those files in one directory?

You do realize that’s now how they should be organized?

500 files in one chunk is going to be slow even on a big honking i7 Linux machine with an SSD.

Please take the time to:

  1. Put your media in the proper structure.
  2. Rescan
  3. Empty Trash
  4. Clean Bundles
  5. Optimize Database.

What you have now is an amorphous pile of ‘stuff’.

1 Like

yes i realize that. this was just a quick search of the entire raid for any file smaller then 200k otherwise there setup according to plex guide lines i do a nightly scan, empty trash, clean bundles, optimize db. the database is currently at 55.5 mb in size. but still all the areas running sluggish and slow. not sure if its the sheere volume thats going through it or something else. and still creating copies on some shows and files

thanks for the help.

Is there any way you can capture this ‘slowness’ you are describing with screenshot video?

I need to understand because “slow” is a subjective term.
I also need to know the structure of the network. Gigabit? Wired/Wifi?

chuck the network consists of the cable modem to router to gibabit switch then to the server and other devices. 2 servers, 4 hdhomerun primes, 2 computers all wired with shielded cat5 cables all gibabit connections. the video is to large to upload. it takes average 2+ minutes to load the recording screen and 1+ minutes to load the guide screen on chrome web app from server to pc. pc has I7 4930 3.4ghz 6 core with 16gb ram gibabit connection and ssd main drive for operating systems as well as 12 tb raid for file storage. it also takes average of 15 + minute when guide updates as well as 5+ minute when you do scan library update as well as it downloading and updating metatag items. even after doing daily procedure as you described prior. Plex Media (15.6 MB)
thanks

If your DB is on SSD and it’s taking this long,

How big is it?

the ssd drive is on the pc accessing plex on the ubuntu server over the network. the program drive on the ubuntu server is 2, 500gb seagate mirrord drives. the data base is currently at 55mb and growing daily.

looks like plex or guide or butler locked up again some time between 7-9 pm 9/27/18 and isnt recording or processing anything. noticed morning of 9/28/18 that guide was refreshing at 5 am and at 3pm still spinning at zero. further investigation in screen shots of issues with not recording files written not complete etc. stopped plexmediaserver process and restarted <a class=“attachment” 2018-09-28%2014_29_28-Season%2005

This is beyond my ability to help.

@sa2000 have you encountered any of these?

and since last sweep of less then 200k files its written 70 incomplete recordings possibly more. so there is some issues here for you guys to help track down. thanks let me know what else i can provide or help with. @sa2000

have to break this down into specifics and for each specific identified issue to have logs covering the time and can then look at the logs

Pick up a specific - whether it is guide, butler activity, a recording and we concentrate on that - one at a time

ok lets start with the guide issue and the crash. after restarting the service it took the guide 1 hour to update. attached is the logs since the service restart the posts before have for the last several days including prior to service restart after crash. Plex Media (13.2 MB) @ChuckPa @sa2000 thanks for all your help and time. hopefully we can get to the bottom of it and iron and smooth things out. let me know if you need additional info went to recordings and its timing out refreshing page and server looks like this,

@ChuckPa @sa2000 since restart yesterday and installing new version of plex seems like its malfunctioning more. nothing shows recorded since yesterday after noon ex restarted plex media server seems back online for the most part.

The attached screenshot above shows a 21% CPU utilization across 4 processors
Examining it further shows PMS and it’s support processes.

The logs show, almost exclusively, LiveTV session transcodes and recording.

The transcoding accounts for the CPU utilization.
Database operations appear normal.

I can not speak to DVR operations of the grab but this is a “Capture network packets & write to disk” loop requiring little CPU.

The Xeon in use has 7932 Passmarks.
https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+X5670+%40+2.93GHz&id=1307

This is slightly less than a 5 year old i7-3740qm (my desktop system).

This level of CPU loading is to be expected with an older CPU.

I have been looking at the logs to see the guide refresh activities

There were two refreshes - one completed in 8 minutes but deferred some of the updates to later background activities that would kick in later - it is called incremental EPG refresh

The second refresh which I presume you instigated at 14:58 took 54 minutes to complete.

Sep 28, 2018 15:49:03.824 [0x7f6490bfe700] DEBUG - EPG[onconnect]: Step 56/56 (2018-10-12T12:00Z) (network: 584.8 sec, database: 2466.9 sec total: 3048.4 sec)

A big factor is the number of channels. If you have 500 channels, for example, that time is about right