Extremely many files in plexdata!

My server (running FreeBSD 11.1) has quite a lot of music, TV-series and movies. But still, I cannot understand the need for SO MANY files for content metadata. Currently I have 1 297 272 files. More than ONE MILLION! :slight_smile:

Is this at all normal? What can I do to ensure only relevant files are there? What can I do to try to alleviate this?

  • Movies: 441

  • TV-series (episodes): 1 574

  • Songs: 33 170

    $ pwd
    /usr/local/plexdata

    $ ls -laR | wc -l
    1297272

    $ freebsd-version
    11.1-RELEASE-p6

It is pretty much the way Plex does things. A file for every need and it does not matter if they are truly needed or not.

lol. You are no alone. I absolutely can not understand why PLEX downloads all artwork for a given movie. I have like 80 posters for Lord of the Rings. BUT I can only view one. Why download them all!!!
1 movie = 120 files at about 5MB. It even downloads posters for other languages. WTF! Why?

That is one of the MOST inefficient thing about PLEX. Save time and money by downloading only what is needed.

@NewPlaza said:
1 movie = 120 files at about 5MB. It even downloads posters for other languages. WTF! Why?

I really believe the command Clean Bundles should clear this unneeded stuff. But it doesn’t, of course.

How many languages are represented in the media you have indexed?

PMS will retrieve the information for all languages found. (It presumes you may want Dutch posters if it finds dutch audio or subtitle tracks).

I have just over 50,000 items (audio & video) indexed in PMS

[chuck@lizum Plex Media Server.102]$ ls
Cache/   Crash Reports/  Media/     plexmediaserver.pid  Plug-in Support/
Codecs/  Logs/           Metadata/  Plug-ins/            Preferences.xml
[chuck@lizum Plex Media Server.103]$ cd Metadata/
[chuck@lizum Metadata.104]$ ll
total 24
drwxr-xr-x.  6 plex users 4096 Dec 13 18:25 ./
drwxr-xr-x. 10 plex users 4096 Jan 16 15:25 ../
drwxr-xr-x. 18 plex users 4096 Nov 27 21:58 Albums/
drwxr-xr-x. 18 plex users 4096 Nov 27 22:09 Artists/
drwxr-xr-x. 18 plex users 4096 Dec  1 14:46 Movies/
drwxr-xr-x. 18 plex users 4096 Dec 13 18:33 TV Shows/
[chuck@lizum Metadata.105]$ find . -type f -print | wc -l
75390
[chuck@lizum Metadata.106]$  cd ../Media
[chuck@lizum Media.107]$ !find
find . -type f -print | wc -l
23194
[chuck@lizum Media.108]$ 

@ChuckPA said:
(It presumes you may want Dutch posters if it finds dutch audio or subtitle tracks).

But not 50 copies!! (over exaggerating the correct amount). But still. I don’t need that many

@NewPlaza said:

@ChuckPA said:
(It presumes you may want Dutch posters if it finds dutch audio or subtitle tracks).

But not 50 copies!! (over exaggerating the correct amount). But still. I don’t need that many

Can you show me what you have? (directory listing)

\Metadata\Movies\d\721aef66f41a2e7875af5df62e609b64a55532d.bundle\Contents\_combined\posters\ com.plexapp.agents.fanarttv_157419ab540a99e2155f3a4e48c95147c129ad71 com.plexapp.agents.fanarttv_1dc45a20d493780221586b6b2e5b1c40a4701d29 com.plexapp.agents.fanarttv_2158eee11fbe524695b15f4c601cd55986b2afc9 com.plexapp.agents.fanarttv_25ebc73fd292ca89cc704a2c894f9fda1497380e com.plexapp.agents.fanarttv_312b4f16af71b6e90cfda056b00d766be8fd49dd com.plexapp.agents.fanarttv_31bf51a430fb2918cc2fa848bfb45ead8c1910b1 com.plexapp.agents.fanarttv_3202956ecf2919618b77ad18d16f7b6ccffbfc05 com.plexapp.agents.fanarttv_3a6821ab6ffa1c0ab6fe7bc7b1922cede3c23945 com.plexapp.agents.fanarttv_44107d0e9975729cd4c30358f8eaa9b4eb7360e2 com.plexapp.agents.fanarttv_633a3efc81222af063bbfd7a3a2769ecc8f5529b com.plexapp.agents.fanarttv_63d5e0cdd8c1b27d8ed8faf23aa7082e07f0ee6c com.plexapp.agents.fanarttv_69adb42bee840b2703794a7fd408f78e4df63b8f com.plexapp.agents.fanarttv_6a2a9a20a1b86be8b7d5c6de812363f1b132a4f5 com.plexapp.agents.fanarttv_6bbb60de88fbc7a309f558bbb247a5ebfb32d0ea com.plexapp.agents.fanarttv_6ec9ac5de2e5468c67bca7f54cb77c9b5403f099 com.plexapp.agents.fanarttv_7213e321ff1eabae1b697fabdb420d4a8c732259 com.plexapp.agents.fanarttv_76b5ac68ccb4433032df8976f81b66f00e6a41f1 com.plexapp.agents.fanarttv_80f6b0bf0fc685e1d8d5563c217f6777d6504c0b com.plexapp.agents.fanarttv_80fa19591104e1a1d307366e8dc7a66efb62e712 com.plexapp.agents.fanarttv_923bd22b002671b9a380a253de514d0293a939d4 com.plexapp.agents.fanarttv_93ab9b6f9c2edb5a269450ac1096daa5b62c0dce com.plexapp.agents.fanarttv_9edb4e6f15da88d334da3a260729c5e21ae3aece com.plexapp.agents.fanarttv_a115c1161409393ba67c0cc991371e15e339ffdc com.plexapp.agents.fanarttv_b39bec222a1e8fbeeed3feb3bb4cfd3b4408c9de com.plexapp.agents.fanarttv_bae0ebd8029d6fdd1bd44e01f8c83b35cf0916a8 com.plexapp.agents.fanarttv_be553ef3ef17cd8b392409b1509e69e98f2391e9 com.plexapp.agents.fanarttv_ea9be8598566f79b5e1c8de6f7e9122b5c493a0e com.plexapp.agents.fanarttv_efd59f3c3bae68e4168457ef7d2b351f0b4d04b2 com.plexapp.agents.fanarttv_f3aaafc88f623bbb9f82d225b4b497bcd2051b58 com.plexapp.agents.imdb_0efcfe24d5e8f3790a7a7364b27c5c91f92a1099 com.plexapp.agents.imdb_23799220942b5e7be7588a87679a4c124b447fbb com.plexapp.agents.imdb_347451e46ed9d109e4fe38f2add0eb98b22f900d com.plexapp.agents.imdb_36a1eca4e837a6b4f5dc7fadce773445eb8be755 com.plexapp.agents.imdb_47abdccd206cfd5e41f42e4851292e6af34696ef com.plexapp.agents.imdb_5de97e850641545c0add2db685c178e3cee1a6fb com.plexapp.agents.imdb_80afd594ab0a80712d511930ac688ecd6b08756c com.plexapp.agents.imdb_8e91f6ae69f773fa059c92f0bf3d71f6b8921534 com.plexapp.agents.imdb_96e208d157680e92978e43a919425817d200e2b4 com.plexapp.agents.imdb_9f7f242bd8b822b42b2ca49c815fcdc1c0739eef com.plexapp.agents.imdb_bd0c25768ac89c9c1c1efb4a1cffda73b77483a6 com.plexapp.agents.imdb_c5999bd0a1ba8bb9e35ca9a6134fc4e75c5446d1 com.plexapp.agents.imdb_c5ba567decfdefb2c6e36b61c3ea83f4626e4410 com.plexapp.agents.imdb_d7ab7c30de97357c7ace5901dccb1e7bcc9e6c1e com.plexapp.agents.imdb_e079c4cc63fcd38e0d954a6b2cf0b1bf764c8be2 com.plexapp.agents.imdb_e9d096a8d645cd8fb20c87beeb2f471db1225e72 com.plexapp.agents.imdb_f5567d56882ffc4bf1818942e4b555d6128f7833 com.plexapp.agents.themoviedb_0efcfe24d5e8f3790a7a7364b27c5c91f92a1099 com.plexapp.agents.themoviedb_23799220942b5e7be7588a87679a4c124b447fbb com.plexapp.agents.themoviedb_347451e46ed9d109e4fe38f2add0eb98b22f900d com.plexapp.agents.themoviedb_36a1eca4e837a6b4f5dc7fadce773445eb8be755 com.plexapp.agents.themoviedb_47abdccd206cfd5e41f42e4851292e6af34696ef com.plexapp.agents.themoviedb_5de97e850641545c0add2db685c178e3cee1a6fb com.plexapp.agents.themoviedb_80afd594ab0a80712d511930ac688ecd6b08756c com.plexapp.agents.themoviedb_8e91f6ae69f773fa059c92f0bf3d71f6b8921534 com.plexapp.agents.themoviedb_9f7f242bd8b822b42b2ca49c815fcdc1c0739eef com.plexapp.agents.themoviedb_bd0c25768ac89c9c1c1efb4a1cffda73b77483a6 com.plexapp.agents.themoviedb_c5999bd0a1ba8bb9e35ca9a6134fc4e75c5446d1 com.plexapp.agents.themoviedb_c5ba567decfdefb2c6e36b61c3ea83f4626e4410 com.plexapp.agents.themoviedb_d7ab7c30de97357c7ace5901dccb1e7bcc9e6c1e com.plexapp.agents.themoviedb_e079c4cc63fcd38e0d954a6b2cf0b1bf764c8be2 com.plexapp.agents.themoviedb_e9d096a8d645cd8fb20c87beeb2f471db1225e72 com.plexapp.agents.themoviedb_f5567d56882ffc4bf1818942e4b555d6128f7833







Wow. I do not have that.

I smell a bug report coming.

Care to help?

@ChuckPA said:
Wow. I do not have that.

I smell a bug report coming.

Care to help?

Okaaay
 How may I help?

Step 1: Reproduce with a controlled test case.
Step 2: Capture the logs + Directory listings for it
Step 3: Write the bug report, attach the logs + listings and submit

I typically create a test library which points to a directory containing a single, known good, item, on a completely fresh Library directory. (no other media is indexed).

The result is:

a) All PMS defaults are used
b) Only one item indexed - Database is minimal and pristine
c) Metadata and Media directories also minimal and pristine.

I must point out that I’m on PMS 1.9.2.4285. BUT this is not unique to just that version. I have seen this as far back as v0.9.12.
I will create a VM and install the latest non-pp build for this test(1.10.1.4602-f54242b6b dated, December 13, 2017).
Does this still sound good?

The agents are responsible for fetching the metadata presented by Plex.tv. They ask, it gives. If too much is coming down, we can get that fixed.

To confirm:

  1. Fresh install (move your existing Library directory out of the way
  2. Test directory containing one properly named & structured movie
  3. Same for 1 television series with one episode in it
  4. Let it get all the metadata
  5. Do not attempt to play it (keep logs clean)
  6. When done, collect the logs and see what’s in the metadata directories

According to these screenshots, there are 3 metadata sources activated: imdb, TheMoviedatabase and fanart.tv
If you disable ‘cinematerial’ and ‘fanart.tv’ agents under
Settings - Server - Agents - Movies - Plex Movies, you will get much less posters already.

@OttoKerner said:
According to these screenshots, there are 3 metadata sources activated: imdb, TheMoviedatabase and fanart.tv
If you disable ‘cinematerial’ and ‘fanart.tv’ agents under
Settings - Server - Agents - Movies - Plex Movies, you will get much less posters already.

What a bunch of BS. The ■■■■ is broken right out of the box.

@ChuckPA said:
Step 1: Reproduce with a controlled test case.
Step 2: Capture the logs + Directory listings for it
Step 3: Write the bug report, attach the logs + listings and submit

I typically create a test library which points to a directory containing a single, known good, item, on a completely fresh Library directory. (no other media is indexed).

The result is:

a) All PMS defaults are used
b) Only one item indexed - Database is minimal and pristine
c) Metadata and Media directories also minimal and pristine.

Okay. What I did.
Installed PMS 1.10.1.4602-f54242b6b on Windows 8.1(virtual machine) using all defaults.
I deleted the Music & Photo library on initial first-run setup.
Created the library Movies Test #1 and pointed to a network folder with a single movie.
Waited a few minutes and after metadata loaded then captured the logs and directory listing.

On a side note. Took forever and a day but I scanned my entire movie metadata folder and found over 433,000 (3.36GB) duplicate files(excluding all XML’s).

I’m not sure you did what I asked.

  1. Install fresh (no preexisting library sections) using all default settings
  2. Create one section which includes one movie
  3. Let PMS match and pull metadata
  4. The entire tree should contain only one metadata bundle

@ChuckPA said:
I’m not sure you did what I asked.

  1. Install fresh (no preexisting library sections) using all default settings
  2. Create one section which includes one movie
  3. Let PMS match and pull metadata
  4. The entire tree should contain only one metadata bundle

No, no, no. The last post was for MY library, not the test you asked me to preform.

All but one point was done as you instructed. The only thing I did that wasn’t “default” was delete the two built in libraries.

After deleting the libraries, did you Empty Trash, Clean Bundles to make sure everything was gone and then Optimize the Database after?