For the last 3 weeks I have been getting random deadlocks, If I go to http://127.0.0.1:32400/connections?X-Plex-Token=############# I can see hundreds of connections some say paused for over 10 mins.
The latest one was 407 connections!!
I have lost a lot of sleep over this it is actual effecting me mentally and yes I know it shouldn’t, unfortunately it is which is why I am desperate for help!!
I Run on Windows 10 and its been fine for months/years with minimal issues until late last month.
Following this guide I have collected the Logs, dumpfile and also a copy of the connections page.
I also noticed when looking at Resource Monitor the Plex Media Server process had hundreds of items in the wait chain so its clearly locking some where.
Edit: Steps I have taking to try and fix and still not much luck
Full uninstall and reinstall of plex more than once
Full Nuking of Database and Metadata and rebuild (this took almost a week to do)
Edit 12/06/2021:- While this has been giving me Anxiety attacks I have sort help!, Also I am hoping another team member can hop on and let me know if there’s been any progress with the various diagnostics I have been sending and/or if anything else would be needed to help with the investigation?
While it has reduced down to once a week since update 1.23.1.4602 with the DNS fix, it dose still happen and I do believe these are connected!
I have found that killing Plex and then restarting my router will normally solve this however sometimes I have to keep plex off for about 40-60 mins before starting it back up otherwise the issue will appear within a matter of min’s.
Is there anyone at all that can help me try and pin down what is the problem.
This whole thing actually ended up making me rather ill due to the stress!!
While it has improved it still happens at least once every 7-10 days.
Along with the full Nuke of the DB and metadata drive I even ended up fully nuking the server, everything bar the media was fully nuked and drives zeroed.
Yet I still get this, it all started about 3 months ago now I have a feeling it’s something on my network but I have no clue to to test and troubleshoot as everything works perfectly fine at full speed bar Plex when it dose this.
What I have noticed in the wait chain I mentioned in last post is it says Plex is waiting for network I/O which is why I am thinking something is holding it up at random on the network.
Good luck with your anxiety; it’s a big deal and I hope you’re getting whatever help you need.
Do you notice any patterns in the connections? Are there are large number from specific IP addresses, or certain users, or to specific endpoints? I’m wondering if there are any clues that might help diagnose the issue, or might help you workaround or avoid the problem.
Do you have any additional security software on the Windows server? Antivirus, firewall, and network-security software is notorious for interfering with networks connections and database file access.
Happy to help. You mentioned you have captured process dump / connections list and logs for one of these - if you can upload somewhere and send me link by Private Message - I will look into it. I only work one day a week - so if you get the diagnostics today I will look into it and if the evidence is good - i will refer it to the development team. If not today, then will be around next Tuesday. It is always best to get the diagnostics from the current version - but if you have it from a recent release that will be good enough
Thank you, yeah in the end I shut plex off for a few days and basically slept for 3 days lmao.
Yeah it never seems to be the same users but normally a very similar listing of “Paused 212.961s - GET /:/timeline?key=%2Flibrary%2Fmetadata%2F229187&ratingKey=” obviously with the user and IP along with the key for the media.
Its the paused bit as that time can be from a few seconds right up to 10+ Mins.
Thank you for the complete set of diagnostics. Perfect.
I have referred the details to the development team
The deadlock was on 1.22.3.4392
Would be good if you also get a set of diagnostics from the current beta - or whichever is current when you get the issue again
Oh could I ask, that I be updated as to if its a bug or something my end when more info is found out as this has effected me mentally due to the stress that I would appreciate having my mind put to rest.
So far no, I am hopeful it was the DNS thing that was the problem but not knowing what I’m looking at in the logs etc.
So I’m not 100% sure if its fixed or just biding its time, not to mention it went on for 3 months and at random.
So as you can imagine my anxiety is still rather high lol
@sa2000 Unfortunately, it has happened again in the last 30 mins (04/06/21) so I have sent you another set of diagnostics
Please do let me know the progress as this did course anxiety attacks, I have been trying really hard this last week not to let it effect me.
However I have been able to restore it a lot faster this time round, I killed the process rebooted my router once the internet was back up I restarted Plex and it has fixed it.
I suspect this is part of the DNS fix ( #12710) that’s actually still being a problem! as since that update went out it has reduced in frequency a lot!
Thanks for the new deadlock diagnostics = logs / connections list / dump
I have referred them to the development team - they were for a deadlock on 6th June with requests starting to hang at 22:14 running on 1.23.2.4625-a83d2d0f9
@sa2000 Unfortunately, it happened again, I didn’t capture anything this time as I just shut it off and have left it, not worth the stress. I do hope all my previous captures (still available on drive) are enough for the team!
I have also noticed, it seems to be mostly Friday nights it happens (never the same time, and never the same users!)
If it helps at all, I am on BT Full Fibre 1Gbps, with the Smart Hub 2 (cos I believe this may be a facture), if the Devs need any more details let me know, I do have the logs from tonight just not the connections or dump file.
