Best Practive Advice For Fast Scanning Of Large Libraries?

Server Version#: Linuxserver Docker (locked out due to large scan in process so can’t get version)
Player Version#: 4.22.2

My library is quite large with thousands of movies and tv shows currently structured:

/movies/movie1 (year)/ /movies/movie2 (year)/ … /movies/moviexxxxx (year)/
/tv/tvshow1 (year)/season1/ … /tv/tvshowxxxxx (year)/season1/

etc etc etc

I’m finding scans are taking a very long time. Sometimes new files appear immediately, but sometimes they take a while. When I do a full library scan e.g. I’m currently creating new temporary libraries to separate my HD and 4K content (merged in my tv library) to make it easier to remove duplicates, it takes literally days to complete.

What’s the best advice for speeding up scans of large libraries? I’ve read various things this morning:

  1. files organised my current way is the best
  2. My way isn’t best, and splitting files into directories with less than 2k folders is best e.g. /movies A-C/movie1 /movies D-F/movie 1 is best
  3. Use Plex-Autoscan script to only update the directory that’s changed - But I thought partial scan did this already?

I’d accepted that my music folder /music/artist/album was slow to scan, but if re-organising that as well as my movies and tv shows will make Plex more responsive, then I’ll move that around as well.

Thanks in advance for any replies.

A few pointers here.

  1. Curated correctly, You won’t ever need a third-party “Autoscan” script.
  2. Unless you’re on Windows, all the movies can exist in one directory, albeit a pain to curate :wink:
  3. Separating media by resolution does make the most sense.
  4. PMS has no functional limit regarding how many directories you add to a library section although I would not “micromanage the snot out of it”. If you have 10-20 groupings, all based on storage & curation technique, that’ll be fine to PMS.
  5. The number of directories in total should be checked. The sole purpose of this is for locally mounted media in conjunction with the “Update my library Automatically” detection. The Linux default table size is 8192 directories. It’s easily increased.
  6. Coupling PMS’s “Automatic” with “Partial scan” will always yield the fastest scan results.
1 Like

Thanks @ChuckPa very good points.

I didn’t have automatic ticked (based on more advice elsewhere…) and I’ll research the table size increase, as I’m way past that number - what are the implications of not increasing?

Edit: found your other post after googling table size Linux Tips

To confirm there is no ambiguity, this is the post I recommend

1 Like

scans should not be taking days unless you are starting a completely new plex install and importing them all at the same time.

also, new import of large music library. that can take daaaaays.

best advice?

  • bare metal, don’t use docker or vm
  • store plex data on a dedicated ssd (mine is 1tb only for plex data)
  • enable automatically scan and the partial scan
  • server on same host as data, any type of non-local content will increase scanning time
  • remove or uncheck any not needed agents/plugins.
  • if you are importing content to completely new plex libraries, disable thumbnail/preview generation. You can re-enable it later after all content has been added.
1 Like

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.