Who has the largest library?

General Discussions
21

Media:
Comedy - 34
Documentaries - 8
Kung Fu - 187
Movies - 1744
TV shows - 87 - 7720 Episodes
Porn - Coming soon - ha ha

Music - 228 Artist - 4422 Albums

Storage:
SAN 1 - 8 bay
4 X 2TB 10K SAS RAID 5
4 X 750GB 10K SAS RAID 5

SAN 2 - 8 bay
2 X 1.5TB SATA
1 X 2TB SATA
2 X 500GB SATA

Internal
1 X 250GB SSD OS and System
1 X 180GB SSD Plex

While there are a ton more to list this is only what’s on Plex. Future plans include upgrading SAN2 to larger Drive running RAID5 on all 8 drives and later doing the same with SAN1.

Documentaries:
Issue: Some Documentaries are multipart tv series and some are movies so it is difficult to categorize them.
Solution: Join all multipart TV series into 1 single file and use the Movie Database or have 2 Documentary sections one for TV and one for Movies. I opted for the first solution. No one wants to watch a 12 hour show so it’s a good thing Plex allows you to continue watching from any point.

Media Note:
When dealing with a lot of files it is best to join as many as possible. Multifile movies should be joined into one file, TV shows with multipart episodes should be joined into one file. The reason may be clear to some, but I will explain anyway.

Files are written to blocks which creates wasted space. So if your block size is 1KB a file that is 1.2KB and a file that is 1.3KB will actually take up 4KB with 1.5KB wasted space. If you join the file the total 2.5KB so it takes up 3KB with .5KB wasted space. So you save 1KB by joining the files and over a large amount of files that savings can add up. Also it reduces your allocation table size since you only have to index 1 file instead of 2 which in turn speeds up your searches and makes updating your libraries easier.

22

2,405 Movies
10,938 Episodes (285 Shows)
Somewhere around 20TB

23

I’m currently at… (and growing daily)

1902 Movies (almost all high def except really old ones)
264 TV Shows, 1335 Seasons, and 22,192 Episodes (and tons more I haven’t sorted and loaded)
605 Artists, 3839 Albums, 34098 Tracks
50 High Def Drone videos I’ve shot (DJI Phantom P3A)

Server:::

Dell R905 - 4 Physical Processors, 4 cores per processor (16 cores total), 64GB RAM, Quad port Gigabit NIC
-Root server runs Windows Server 2012 and only runs VMs and handles the drives, all drives are mapped to Plex VM
-Plex runs on a VM (8 Cores and 16GB of RAM for the VM)
-Domain Controller, DNS Server, and VPN all run on a separate VM
-2TB Raid 1 for OS and Download storage
-750GB for Music and OS backup (RAID 1)
-16 TB of External USB 3.0 MyBooks (4TB per) for Movie (1) and TV Show (3) Storage
-Total storage is about 24TB. I use the other space for other computer backups and picture storage, etc…

My future plan is to move into a Raid array using SCSI to connect a Dell MD1000 filled with hard drives instead of external usb.

I only share with family, I’ve had 8 streams going at the same time. 1 on the local network, 1 via cellular, and 6 to other home internet approx 30 miles away. Never missed anything. No buffering at all for anyone. I couldn’t believe it. Lol

25

Q: “Who has the largest library?”

A: “That may be The Library of Congress - The Senate is checking that and will get back with us after Trump’s Nuclear Winter.”


(I hope they’re moving a lot of this stuff underground)

Personally I go with The Las Vegas Mentality - Never Gamble More Than You’re Willing To Lose. EVERYTHING in a box with a fan in it is subject to self destruct at any moment. I expect it to happen because it will - eventually - and it won’t take a Nuclear Weapon. ‘Tuesday’ may be enough.

26

Anime - 103 Series, mostly complete, dual audio where I can.
Documentaries - 264 ( single episode documentaries, an hour or longer usually.
Educational Shows - 210 (These are Documentary SERIES)
HD Movies - 2765 (95% 1080p)
Kids Movies - 665 individual movies, mixed qualities. 1080p where applicable
Kids TV Shows - 337, most are complete.
Music - 206 Artists, mostly discographies in 320 kbps.
SD Movies - 548 (Standard Definition, mostly older classics from the 70’s to 90’s.
Stand Up Comedy - 460 individual Stand Up acts.
TV Shows - 1141 shows, 95% of them are complete. 95% are Standard Def. 5% High Def.

All Episodes in all 4 episodic categories add up to 96,755 total episodes currently.

Backed up with Dual Parity. Been working on this for a LONG time. Long before I found Plex.

Plex just made my life so amazing and beautiful when I finally found it. I will always remember the day my life was changed when I found Plex. It will forever be different because of it.

I don’t meet too many people with a collection near mine so I would like to maybe touch base with a couple people with a collection near the same size.

27

@JuiceWSA said:
Q: “Who has the largest library?”

A: “That may be The Library of Congress - The Senate is checking that and will get back with us after Trump’s Nuclear Winter.”
https://www.loc.gov/
(I hope they’re moving a lot of this stuff underground)

Personally I go with The Las Vegas Mentality - Never Gamble More Than You’re Willing To Lose. EVERYTHING in a box with a fan in it is subject to self destruct at any moment. I expect it to happen because it will - eventually - and it won’t take a Nuclear Weapon. ‘Tuesday’ may be enough.

This brings up a story of the beginning/end of the universe:
There was a universe with a large number of inhabited planets.
On each planet there was at least one “intelligent” species.
One of the earliest creations of every species was the “bureaucracy” and the paper work that comes with it.
No “bureaucracy” ever destroyed even one piece of paperwork. It was all stored in underground vaults.
One day one of the oldest of these species created their last piece of paperwork and stored it.
As soon as the paper was placed in the files they began to implode and soon the entire planet collapsed into a paperwork black hole. (It was actually more grayish in color)
The grey hole exerted forces on other nearby bureaucratic file systems and they began to collapse and combine with others and so on.
This went on for a while and soon the forces became so great that the entire universe was consumed.
But the inertial force of all those bureaucracies combined was too great to be contained and the grey hole exploded creating yet another universe with all the bureaucracies it could contain.
This continued over and over for several cycles while God watched.
God decided that the bureaucracies were worse than Satan so he(she) banished all the bureaucrats to H3ll so as to avoid future collapses.
This caused a stability and peace in the universe that will last until “people” create something to replace bureaucracy.

Unfortunately this universe is only half way through the second cycle and we have at least 10 more cycles before God steps in and even then people are so creative that there will be a replacement for bureaucracy that is even worse before we even have time to enjoy the lack of one.

Now I am wondering if the universe has come up with the replacement on the fly and now electronic data is growing at an exponential rate and will cause the universe to implode into something completely different. where there is no way to isolate the bureaucrats and so will fulfill the real definition of H3ll.
And all you data hoarders are contributing to the downfall of this universe and will be responsible for the H3ll that is to come.

28

As deep as that is/was, I don’t appreciate being compared to evil and the end of the universe lmao. But yeah man good stuff… all I know is if we lose net neutrality I am unplugging and going underground.

Ad Hoc will make a HUGE come back haha. Look for me, I’ll be with the guys creating the new Internet.

We may lose the battle but the war will be won on a completely different battlefield.

And I can bring the Seinfeld.

29

removing library details

Not looking for randoms shares

This is all on a server I built back in 2011 and haven’t upgraded anything but drives & Power supply i’m sitting around 144tb raw right now
Norco 4224 24 bay - Heavily modded
Dual Xeon Hexcores X5660
SuperMicro Motherboard
lsi 9211-8i controller
HP HBA
40gb Samsung DDR
corsair 850w power supply
2x SAMSUNG 850 500gb drives. One for Windows Server 2008 R2 OS, other for Plex VM
12x Toshiba N300 8TB drives
12x HGST 4TB Deskstar

30

I would have to say… I do not have my Library nearly as “laid out” as most of you. but here are my stats…
Movies - 11937 - I would say its like 99% HD either 720p or 1080p, Even the really old movies are either remastered versions or up-scaled versions.
TV Shows - 339 - Most are complete, most are 720p or higher except older shows that never had an HD release.
Total TV Episodes - 21379

I also have 4TB of Music that I have yet to add because… well im lazy.

I have 2 C2100’s with 10 6TB hard drives in them as well as a C1100 with 4 4tb hdds in it. I have plenty of space for expanding. lol.

Actually I just looked I only have 16 movies that are not “At Least” 720p.

As a side note, I have burned out 8 blu-ray burners/drives ripping stuff. Turns out they don’t like to be run almost 24/7.

welp, that was a bad first post, I necro’d a thread… sorry. Also, If you try to friend me on plex I will reject.

31

Really Nice!

32

@Alup, very nice.
@coastside that is awesome. i’d love to see your library and possibly share back.

33

I have 402 TV Shows (16031 episodes) and 1573 Movies. Totals to 63.9TB, all on Google Drive

34

This is what I’m currently sitting at.

35

WOW im amazed with some of you guys! 6000+ movies!

i just hit 20tb 1635 movies 147 tv shows 6329 eps

36

I just finished a purge on my system removing a lot of movies and shows I know I’ll never watch again. But when it’s hard to get through them the first time there is no point in keeping them.

That was hard to do at first because you become a pack rack of video. :slight_smile:

I keep my sig roughly updated with my numbers.

37

Just out of pure curiosity. How are you all getting so many TV shows? Are they complete? If they are not complete up to the episode then I understand but damn you guys/gals are insane with your tv shows. On a side note anyone with more than a few thousand movies has beat netflix so GJ!

One more thing. If anyone is curious or worried about space I wrote a powershell script to take care of that. Its a batch converter using handbrakecli it will shrink the size of the file but the file will still be very good quality. If you want it higher quality than what it outputs you can change the flag -q 24 to what ever pleases you (lower the number = better quality). you will need to save the file as .ps1 to run it.

BE CAREFUL RUNNING THIS!

The way I have it setup is that it deletes the old file after it has converted! You can stop this delete funtion buy placing a # in front of the line Remove-Item -Force $oldfile example:

#Remove-Item -Force $oldfile

This script will also trim any black border space around the video this is the main reason I have it because its such a PITA to do that function in an editor. On top of that it optimizes the files for web streaming (reducing the initial load time). It does some other stuff too but you can modify it to your liking. This is my gift to the Plex community!

$host.ui.RawUI.WindowTitle = "Alup Batch Converter"
Write-Host Please enter the path to the root directory where the files reside.
$path = Read-Host "Enter the path"
$filelist = Get-ChildItem $path -Exclude '*.mp4','Season*','Special*' -recurse
 
$num = $filelist | measure
$filecount = $num.count
 
$i = 0;
ForEach ($file in $filelist)
{
    $i++;
    $oldfile = $file.DirectoryName + "\" + $file.BaseName + $file.Extension;
    $newfile = $file.DirectoryName + "\" + $file.BaseName + ".mp4";
      
    $progress = ($i / $filecount) * 100
    $progress = [Math]::Round($progress,2)
 
    Clear-Host
    Write-Host -------------------------------------------------------------------------------
    Write-Host Alup Batch Converter
    Write-Host "Processing - $oldfile" 
    Write-Host "File $i of $filecount - $progress%"
    Write-Host -------------------------------------------------------------------------------
  if (Test-Path HandBrakeCLI.exe)
  { 
    Start-Process "HandBrakeCLI.exe" -ArgumentList "-i `"$oldfile`" -o `"$newfile`" -f mp4  -O -e x264 -q 24 -E aac -6 stereo -R 44.1 -B 96k-x cabac=1:ref=5:analyse=0x133:me=umh:subme=9:chroma-me=1:deadzone-inter=21:deadzone-intra=11:b-adapt=2:rc-lookahead=60:vbv-maxrate=10000:vbv-bufsize=10000:qpmax=69:bframes=5:b-adapt=2:direct=auto:crf-max=51:weightp=2:merange=24:chroma-qp-offset=-1:sync-lookahead=2:psy-rd=1.00,0.15:trellis=2:min-keyint=23:partitions=all" -Wait -NoNewWindow
    Wait-Process -Name HandBrakeCLI.exe
    Remove-Item -Force $oldfile
  }
  else
  {
    Clear-Host
    write-host Error HandBrakeCLI.exe not found! $objItem.Name, $objItem.WorkingSetSize -foregroundcolor "red"
    Write-Host Press any key to exit...
    $x = $host.UI.RawUI.ReadKey("NoEcho,IncludeKeyDown")
    Exit
  }
}

PM me if you have any questions regarding this script and I will try to answer them to the best of my ability.

If you do not understand this script DO NOT RUN IT! This script “Especially the delete function” can decimate a video library very quickly!

38

@Alup said:
Just out of pure curiosity. How are you all getting so many TV shows? Are they complete? If they are not complete up to the episode then I understand but damn you guys/gals are insane with your tv shows. On a side note anyone with more than a few thousand movies has beat netflix so GJ!
Netflix actually doesn’t have nearly the content people think it does. It’s actually dropping each year (for the last few). Netflix right now has about 3,709 movies and 1,045 TV series. They of course have many shows with only a season or two or series that they don’t carry the full boat. So if you have 300 or so series, you probably have more total episodes then Netflix as well.

One more thing. If anyone is curious or worried about space I wrote a powershell script to take care of that. Its a batch converter using handbrakecli it will shrink the size of the file but the file will still be very good quality. If you want it higher quality than what it outputs you can change the flag -q 24 to what ever pleases you (lower the number = better quality). you will need to save the file as .ps1 to run it.

BE CAREFUL RUNNING THIS!

The way I have it setup is that it deletes the old file after it has converted! You can stop this delete funtion buy placing a # in front of the line Remove-Item -Force $oldfile example:

#Remove-Item -Force $oldfile

This script will also trim any black border space around the video this is the main reason I have it because its such a PITA to do that function in an editor. On top of that it optimizes the files for web streaming (reducing the initial load time). It does some other stuff too but you can modify it to your liking. This is my gift to the Plex community!

$host.ui.RawUI.WindowTitle = "Alup Batch Converter"
Write-Host Please enter the path to the root directory where the files reside.
$path = Read-Host "Enter the path"
$filelist = Get-ChildItem $path -Exclude '*.mp4','Season*','Special*' -recurse
 
$num = $filelist | measure
$filecount = $num.count
 
$i = 0;
ForEach ($file in $filelist)
{
    $i++;
    $oldfile = $file.DirectoryName + "\" + $file.BaseName + $file.Extension;
    $newfile = $file.DirectoryName + "\" + $file.BaseName + ".mp4";
      
    $progress = ($i / $filecount) * 100
    $progress = [Math]::Round($progress,2)
 
    Clear-Host
    Write-Host -------------------------------------------------------------------------------
    Write-Host Alup Batch Converter
    Write-Host "Processing - $oldfile" 
    Write-Host "File $i of $filecount - $progress%"
    Write-Host -------------------------------------------------------------------------------
  if (Test-Path HandBrakeCLI.exe)
  { 
    Start-Process "HandBrakeCLI.exe" -ArgumentList "-i `"$oldfile`" -o `"$newfile`" -f mp4  -O -e x264 -q 24 -E aac -6 stereo -R 44.1 -B 96k-x cabac=1:ref=5:analyse=0x133:me=umh:subme=9:chroma-me=1:deadzone-inter=21:deadzone-intra=11:b-adapt=2:rc-lookahead=60:vbv-maxrate=10000:vbv-bufsize=10000:qpmax=69:bframes=5:b-adapt=2:direct=auto:crf-max=51:weightp=2:merange=24:chroma-qp-offset=-1:sync-lookahead=2:psy-rd=1.00,0.15:trellis=2:min-keyint=23:partitions=all" -Wait -NoNewWindow
    Wait-Process -Name HandBrakeCLI.exe
    Remove-Item -Force $oldfile
  }
  else
  {
    Clear-Host
    write-host Error HandBrakeCLI.exe not found! $objItem.Name, $objItem.WorkingSetSize -foregroundcolor "red"
    Write-Host Press any key to exit...
    $x = $host.UI.RawUI.ReadKey("NoEcho,IncludeKeyDown")
    Exit
  }
}

PM me if you have any questions regarding this script and I will try to answer them to the best of my ability.

If you do not understand this script DO NOT RUN IT! This script “Especially the delete function” can decimate a video library very quickly!

There are probably a few things you might want to change in your script that are hard coded that most likely shouldn’t be. You might want to think about the AAC 6 channel audio track as well as 2 channel is a default that all clients can handle without triggering transcoding on the server. (better to keep the existing audio tracks while creating a new AAC track if needed).

39

How do you guys back up such huge libraries?

40

@cayars said:
There are probably a few things you might want to change in your script that are hard coded that most likely shouldn’t be. You might want to think about the AAC 6 channel audio track as well as 2 channel is a default that all clients can handle without triggering transcoding on the server. (better to keep the existing audio tracks while creating a new AAC track if needed).

I think you need to re-read that, I think you are getting 2 different flags mixed up.
-f mp4 -O -e x264 -q 24 -E aac -6 stereo -R 44.1 -B 96k
-f is the file output container format
-O means it is being optimized for web streaming
-e is the video encoder.
-q is the quality of the video
-E just specifies the audio encoder. in this case I want the audio to be encoded in aac.
-6 just specifies the mixdown in this case i want it to be stereo. granted i could do something like 5point1 or higher but stereo is just fine for all my watching needs as well as most peoples.
-R is the sample rate
-B is the Bitrate

@wildkeny said:
How do you guys back up such huge libraries?

I use Backblaze.

41

Sorry I quickly scanned over it and was thinking you were doing 6 channel. I also wasn’t paying attention that you used Handbrake and not ffmpeg. My bad!

But I got to ask, why are you using settings that are worse then the defaults for both audio and video?
Why do you want to remove multi channel sound and convert everything to 96K stereo?
Is your goal to just save as much disk space as possible? I ask because the settings you are using aren’t far off what I’d use to convert files I want to take/watch on my mobile devices with small screens and poor audio (unless using headphones).

That’s what I was getting at. You are using one set of defaults for everything vs checking the current file and determining if you can use worse or better CRF and same with audio.

I myself would not want to discard the multi channel audio as that can play a huge part in the experience.