Every folder in TV library being scanned individually = VERY slow scanning

Server Version#: 1.28.0.5999

This is a resubmit of a previous thread that was not solved and is still happening to this day.

Alerts output right now as PMS is preforming an automated scan of my TV library:

As I’ve said the last two times I’ve reported this issue:

  • PMS running on Windows 10x64 Pro
  • TV library is made up of three SMB shares on the same Windows Server 2019

Library scanning settings:

When a scan like this is running, the Activity indicator on the PlexWeb main page shows a progress circle for each folder - further indicating that PMS is running an individual scan process on each folder.

So - the question is why does PMS queue up a individual scan for each and every folder/sub-folder on each of the SMB shares?

I can DM logs to a developer if they want to see them from the time period of this scan.

Your old logs indicated that there was a change to the files. Could just be their last accessed date.

The flag that tells PMS that a file changed comes from the OS that controls the drive itself, so Windows Server 2019. Do you have anything that may monitor and scan those folders? i.e. virus, backup, rclone, active directory, etc?

Thanks for looking at this MovieFan

There is a backup job run by Veeam on the Server 2019, but that is at 01h30, and the folders in question are excluded from the backup job.

Windows Defender is running. Real Time Protection is enabled. There are no AV exclusions defined.
The server is an AD domain controller.
The three volumes that contain the three SMB shares do have data-deduplication enabled on them.

Next time you see this happen, check the AD audit logs to see if something affected those files.

I’m not sure how the de-duplication works. Is it possible to turn this off temporarily to see if it makes a difference?

These are the only things I can think of that may affect the files, but it does seem like something is affecting the files.

By AD audit logs do u mean the Windows Event Logs - AD section?

I’ll research disabling the de-dup active process temporarily. I know it runs on a schedule in the wee hours of the morning.

The Disable-DedupVolume cmdlet disables further data deduplication activity on one or more volumes. After you disable data deduplication, the volume remains in a deduplicated state and the existing deduplicated data is accessible. The server stops running data deduplication jobs for the volume and new data is not deduplicated. To undo data deduplication on a volume, use the Start-DedupJob cmdlet and specify Unoptimization for the Type parameter.

After you disable data deduplication on a volume, you can perform all read-only deduplication cmdlet operations on the volume. For example, you can use the Get-DedupStatus cmdlet to get deduplication status for a volume that has data deduplication metadata. After you disable data deduplication on a volume, you cannot use the data deduplication job-related cmdlets and the Update-DedupStatus cmdlet to perform operations on the volume. For example, you cannot use Start-DedupJob to start a data deduplication job for a volume on which you have disabled data deduplication.

Disable-DedupVolume -Volume "D:","E:","F:","G:"

I’ve noticed the Scanner doing this again tonight, so I’ve now disabled De-Dupe on the three volumes with TV Shows on them. I’ll see if it happens again.

Nope, that hasn’t helped:

This server is being backed up by Veeam, but the folders that hold the TV Shows media are not included in that backup - so I don’t think that would be the cause.

Can you get me the entire log?

Logs from just now. And the PMS just finished another round of the folder-by-folder scanning.
Plex Media Server Logs_2022-08-19_13-47-28.zip (5.9 MB)

I have just disabled Veeam backing up that server.

Have you had a chance to look at the log @anon18523487 ?

BTW, stopping the backups of the host W2k19 server hasn’t stopped the weird folder-by-folder scanning.

Something is triggering PMS to scan those folders, but it’s already in the middle of the process so I can’t tell what triggered it.

Can you restart your PMS and wait a few minutes. Check if it is scanning, if not wait a little longer. I’m hoping what triggers it will show up. Get me a new log. If the scanning doesn’t start after about 30 minutes, get me the log anyways.

The TV Shows folder did not get scanned. The Pictures library did however.
Plex Media Server Logs_2022-08-24_11-01-31.zip (6.0 MB)

Not sure why the pics are all being added again. Nothing has changed in that folder other than a dozen new photos added to August 2022 folder.

OK, PMS started doing it a little while ago (16h33). Here is the log.
Plex Media Server Logs_2022-08-24_16-41-04.zip (6.4 MB)

Out of interest, it also does it for the ‘Kids TV Shows’ library (also SMB share on the same server).

image

Interesting thing I just noticed in the Alerts - new Movies can ‘jump in’ mid TV Show scanning:

image

Burden is a movie that I added yesterday.

Updated logs.

Plex Media Server Logs_2022-08-24_17-10-56.zip (6.7 MB)