All 1.32.1.6999 PMS agents don't match anymore : PMS CRITICAL core 574

PMS version : 1.32.1.6999
Server system : Windows 10
No VPN, no ad block

Hi,

PMS worked fine for years. Today, after last suggested upgrade, all PMS agents (movies + shows + music) don’t match anymore. The console messages are like this :

MetadataAgentPostProcessor: failed to find agent for identifier tv.plex.agents.music

MetadataAgentPostProcessor: failed to find agent for identifier tv.plex.agents.movie

Scanner [Plex Movie]: unable to find cloud match for item file ‘U:\Slumberland 2022 (Multi) (1080p) (x264).mkv’

When I click on 3 dots + “Match” or “Fix match”, the popup windows comes but nothing is recognized at all :

I tried to change agents for all libraries and it worked roughly :

  • Music : Last.fm
  • TV shows : The TVDB
  • Movies : Plex movie legacy

But actual matching are not as good as Plex native agents : for example, no covers here :

+ it looks like now each library is in duplicated state : movies library with native agent + movies library with new agent. So it is now impossible to manage duplicated movies.

Things I tried :

  • Reboot system.
  • I have read some similar problems and Plex users suggested to change DNS server to 8.8.8.8. This didn’t solve the problem.
  • I disabled plugins/addons/extensions on app.plex.tv. That didn’t solve the problem.

Things I didn’t try :

  • Restore backup
  • Reinstall PMS
  • Downgrade PMS

Not sure the problem is due to Plex last upgrade. It could also be last Windows 22H2 update or Visual C++ update.

Thanks for help

Please restart PMS, wait 3 minutes without doing anything, then try to match 1 movie, wait for it to finish, grab full logs and post it here.

Hi @anon18523487 and thank you for your interest

I did 2 tests because the first test did not look conclusive.

  • 1st test : adding 1 movie and trying to match. Plex scans but nothing happens. No more movie, no more duplicated movie, no more unmatched movie. The movie just doesn’t appear. See fist log below.
  • 2nd test : adding 7 movies and trying to match again. Same ! See second log below.

I ma not able to read and understand logs but this critical error seems to be the problem :

CRITICAL (core:574) - Exception getting hosted resource hashes

Thank you

1ST TRY - Plex Media Server Logs_2023-05-13_11-44-21.zip (7.9 MB)
2ND TRY - Plex Media Server Logs_2023-05-13_12-07-14.zip (7.7 MB)

What do you suggest ? What should I do now ? I’m not able to add medias to PMS since 8 days
Thank you

1 - Try updating to the 64-bit version of PMS.
2 - Don’t store your movies in the root of a drive. Things like “U:\Slumberland 2022 (Multi) (1080p) (x264).mkv” are a bad idea.
3 - Don’t point your library at the root of a drive. Instead, use a Movies folder and point your librraies to that. i.e. U:\Movies, so “U:\Movies\Slumberland 2022 (Multi) (1080p) (x264).mkv” is good.

What files are missing, please provide the full path.

Logs show your J, K and G drives as unavailable.

Okay, I’m now Version 1.32.2.7002 64 bits
Problem is exactly the same

2 - Don’t store your movies in the root of a drive. Things like “U:\Slumberland 2022 (Multi) (1080p) (x264).mkv” are a bad idea.

I’m not using root drives.
Files are stored on PC #1 with 13 HDD and folders like MOVIES 1, MOVIES 2, MOVIES 3, SHOWS, MUSIC… Plex is installed on dedicated PC #2 and use Windows mounted drives from PC #1. So “U:\Slumberland 2022 (Multi) (1080p) (x264).mkv” from Plex server is in fact “E:\Movies 2\Slumberland 2022 (Multi) (1080p) (x264).mkv”.
BTW it always worked fine

Logs show your J, K and G drives as unavailable.

Yes, 3 drives are off because there is no data for the moment. Cost money for nothing.

Let’s have another test :

  • Scanning Plex, wait for finish.

  • Adding the files below (adding more than one because I don’t know at all which are already existing and matched (–> duplicated movie) and which are new ones :

    • 16 Ans 2023 (1080p) (h264).mkv
    • 101 Reykjavik 2000 (1080p) (h265).mkv
    • Adieu Ma Concubine 1993 (1080p) (x264).mkv

What files are missing, please provide the full path.

Full path for these files : F:\___ TEST\ from Plex server (PC #2)
Real path from PC #1 : E:\Films HD 1080p\___ TEST\

  • Close and restart PMS and wait 3 minutes
  • Scan movies again, wait for finish and grab full log below

These 3 movies are totally missing and don’t appear (no movie, no unmatched movie)

Full log below
Plex Media Server Logs_2023-05-15_20-47-03.zip (6.5 MB)

Windows will treat these as if they are the root of the drive. It may work, but when there are issues, this is often the cause.

Your logs don’t show PMS even detecting that folder. Can you provide me screenshots of explorer showing both the real and mapped locations for those files. You can PM me, if you don’t want to share publicly.

Hi @anon18523487

Please, be honest. As you asked me, I provided you 3 zipped dumps of PMS logs. This is about :

  • 450 files
  • 350MB of logs
  • Millions of debug/warning/error/critical lines

And you answer :

  • 3 hard disk drives are off (yes this is true, where is the problem ? These drives are empty and off)
  • MPS doesn’t detect my folders (Off course it does ! PMS is working at the moment)

I will not provide more informations and I will not break my file system which is correct. I did 3 tests and everything you asked that made sense but I will not do useless or stupid things.
Okay, here is the situation : my PMS is actually working. We can stream as usual. But I cannot add any media nor update existing ones anymore.

Did you ever read/explore the logs or not ? I am not able to understand the logs but I can search for “critical” and “error”. Here are some CRITICAL/ERROR in logs for which you should have been alerted :

  • File com.plexapp.sytstem.log :
2023-05-15 20:33:48,604 (39dc) :  CRITICAL (core:574) - Exception in thread named 'refresh_servers' (most recent call last):
File "C:\Program Files\Plex\Plex Media Server\Resources\Plug-ins-86cfcc10c\Framework.bundle\Contents\Resources\Versions\2\Python\Framework\components\runtime.py", line 1126, in _start_thread
  • File com.plexapp.agents.thetvdb.log
2023-05-15 20:14:52,342 (2024) :  CRITICAL (core:574) - Exception getting hosted resource hashes (most recent call last):
File "C:\Program Files\Plex\Plex Media Server\Resources\Plug-ins-86cfcc10c\Framework.bundle\Contents\Resources\Versions\2\Python\Framework\components\runtime.py", line 1293, in get_resource_hashes
json = self._core.networking.http_request("http://127.0.0.1:32400/:/plugins/com.plexapp.system/resourceHashes", timeout=10).content
File "C:\Program Files\Plex\Plex Media Server\Resources\Plug-ins-86cfcc10c\Framework.bundle\Contents\Resources\Versions\2\Python\Framework\components\networking.py", line 243, in content
  • File com.applex.agents.themoviedb.log
2023> -05-15 20:11:12,361 (10a8) :  CRITICAL (core:574) - Exception getting hosted resource hashes (most recent call last):
File "C:\Program Files\Plex\Plex Media Server\Resources\Plug-ins-86cfcc10c\Framework.bundle\Contents\Resources\Versions\2\Python\Framework\components\runtime.py", line 1293, in get_resource_hashes
json = self._core.networking.http_request("http://127.0.0.1:32400/:/plugins/com.plexapp.system/resourceHashes", timeout=10).content

File com.applex.agents.none.log :

2023-05-1> 5 20:03:20,063 (32cc) :  ERROR (networking:197) - Error opening URL 'http://127.0.0.1:32400/:/plugins/com.plexapp.system/resourceHashes'
2023-05-15 20:03:20,065 (32cc) :  CRITICAL (core:574) - Exception getting hosted resource hashes (most recent call last):
File "C:\Program Files\Plex\Plex Media Server\Resources\Plug-ins-86cfcc10c\Framework.bundle\Contents\Resources\Versions\2\Python\Framework\components\runtime.py", line 1293, in get_resource_hashes

… All CRITICALS are same way, it’s not very difficult : CRITICAL core 574 and Python 2 problem.

So, it seems obvious that there is a problem with agents, and PYTHON ! PYTHON all right ? Not file system or disconnected/unused hard drives.

The correct question you should have asked (if you had read the logs) is “Did you change something with Python ?”. And I will have honestly answered: “YES ! I’ve upgraded Python from 2.7 to 3.1 recently for personnal needs

Please, provide relevant informations, otherwise I can manage on my own as usual. From my experience, if you have probleme with PMS, ask the community, not the support.
In France, we have an expression for that, we say “NOYER LE POISSON”. This mean DROWN THE FISH, or bla bla bla bla, I don’t care at all about you. It’s so insulting to people who paid Lifetime Plex Pass to support YOU.

Regards,

1 Like

This has nothing to do with the Python errors, the logs are indicating that your database is getting locked up for too long during start up causing some knock-on effects.

Looks like you have almost 1000 collections which seems to be causing issues on startup as we process these. I’ll file an issue and look into how we can better handle this case.

You might be able to work around this issue in a hacky way right now:

  1. Start your server and wait for about 15 minutes.
  2. Disconnect the server from the network for around 30 seconds.
  3. Then reconnect the network again.

This process should hopefully re-trigger the process to load up the agents properly.

Hi @drzoidberg33

your database is getting locked up for too long during start up causing some knock-on effects

Yes, this behavior started a while ago (months), I don’t really know why. It makes PMS unavailable for a few minutes during every full scan (once a day). Not critical, working fine as well.

Looks like you have almost 1000 collections which seems to be causing issues on startup

Yes. This is PMM (Plex-Meta-Manager). I’ve been using PMM for months, haven’t had any problem. I haven’t launched it for several weeks. I guess this is not the problem. I can “kill them all” if you think 1000+ collections is a really bad idea.


New test according to your suggestions :

18:20 stop/start PMS and wait
18:44 disconnect from internet
18:49 reconnect internet (PMS still running)

Nothing change (I cannot rematch/fix any movie, agent doesn’t match anything at all)

18:51 scan movies
18:59 end of scan. nothing special

Cannot rematch/fix any movie

19:09 adding some movies and rescan

19:18 Movies are added in movie library by didn’t match anything

The situation is not hopeless, backups are ok & we can stream for the moment. But PMS agents look like zombies.

Thank you for your interest in the problem. There is a ■■■■■■■ snake in my boot.

See logs below.

Plex Media Server Logs_2023-05-17_19-19-34.zip (7.5 MB)

There is a bug we are working on related to the old scanner not seeing some files. I’m not seeing the expected errors in your logs so not sure if this is what is going on for you. Can you wait until the next beta release to see if that helps. Should be available in the next day or so.

Well wait and see. Not sure beta will solve the problem. This is overall (all agents, all libraries)

Please could you confirm this is not a Python version problem ? I can go back if needed.

Recurring error :
Framework.bundle\Contents\Resources\Versions\2\Python\Framework

The PMS machine does nothing but Plex. I recently upgraded Python from 2.7 to 3.1. Everything was fine before. Then, the 1.32.1.6999 restarted PMS and… All Plex agents go into zombie-mode. Should I downgrade Python to 2.7 ?

The workaround I suggested doesn’t look like it had the desired effect unfortunately.

Clearing out some of those collections would definitely help, if you’re not using them rather get rid of them as it is what’s causing your specific problem. I’ve opened an issue on our side but it’s something that’s not a quick fix and will require further investigation.

As for Python versions, that has nothing to do with it as we don’t use the system Python version as we bundle our own one with PMS which you cannot change.

Found this post about “PMS CRITICAL core 574” : plugin not starting - windows build · Issue #271 · trakt/Plex-Trakt-Scrobbler · GitHub . Suggestion : problem with Microsoft Visual C++

Uninstall/reinstall VC++

Everything is fine now, as before. Hope this issue could help someone

Thank you.

1 Like

Nice find. Had not seen that before.

Plex Media Server Logs_2023-05-18_19-33-12.zip (3.9 MB)

I also have had this error, I’m on Linux. I followed the suggestion of deleting one collection and suddenly all my metadata got updated. I have attached my logs for a possible fix/patch.

Your logs indicate that PMS detected changes in your movie folder. Specifically a bunch of srt files. But since the movie file didn’t change, PMS did not do anything. Here’s an example.

May 18, 2023 18:46:24.879 [23354600213304] INFO - Library section 1 (Movies) will be updated because of a change in “/data/media/movies/No Time to Die (2021) {imdb-tt2382320}/No Time to Die (2021) {imdb-tt2382320} [Bluray-1080p][AC3 5.1][8bit][x264]-EVO.ar.srt”
May 18, 2023 18:46:29.912 [23354702183224] DEBUG - Skipping over directory ‘No Time to Die (2021) {imdb-tt2382320}’, as nothing has changed; removing 1 media items from map.

This is expected since you have the option enabled to run the scanner when a change is detected. I can’t tell what caused the change. This was triggered at the OS level so it’s not something PMS did on it’s own.

May 18, 2023 18:46:24.879 [23354600213304] INFO - Library section 1 (Movies) will be updated because of a change in “/data/media/movies/No Time to Die (2021) {imdb-tt2382320}/No Time to Die (2021) {imdb-tt2382320} [Bluray-1080p][AC3 5.1][8bit][x264]-EVO.ar.srt”

I see you did have some unmatched movies, so PMS did match these and updated the metadata. There are about a dozen movies I saw this happen for. A few I see are:

Jaws
All about Eve
All Quiet on the Western Front

Im not sure if the logs clearly showed what was happening, I did record a video and send it to the /r/plex discord, I was not able to attach it so ill link it instead. Hopefully it makes it clear what was going on.

https://cdn.discordapp.com/attachments/183275319594188800/1108790800277581874/20230518-1616-13.7593023.mp4

Had to put the link in quotes because it was trying to load it but did not seem to work

Hmm. I found in your logs that match the video. I see where it is getting unmatched. Then it won’t try to match. Looks like the agent is not loading properly. I see earlier PMS was giving a 403 error. That usually means PMS couldn’t communicate with Plex.tv due to something blocking it on the local network. Do you have some sort of Firewall that may be interfering?

I have not changed any firewall rules that could suddenly stop the agent from connecting. I got a suggestion to test if I can access https://metadata.provider.plex.tv/

Was able to do it on both the server (hosting pms) and a client on the network. It weirdly just started working again after deleting one collection.