@danjames92 said:
I don’t have a backup plan. Media is spread across 2 x 3TB drives and 1 2TB. It gets difficult when you have 7.4TB of media.
YOLO :))
7.4 TB of media is nothing. (Well not nothing but quite small) I have almost 18 TB of media and my library is quite small compared to many that post here. There are several folks with upwards of 30-40 TB of data.
With the prices of drives being as low as they and the difficulty of re-ripping and recreating libraries it really makes little sense to not at least back up the videos themselves. But that is entirely up to each person’s desires.
Whether local or online it is simply a good idea to backup any and all data that is not real easy to recreate.
Yea, 7.4 TB is easy to backup. Just pickup a Seagate 8TB Archive drive and call it a day.
I’ve got 2 independent backups offsite in the cloud.
I use Snapraid with 2 parity drives at present locally. So at present it would take a 3 drive failure for me to loose data on any one drive. In that case I can pull 1 drive worth of content down from the cloud in about 2 days (done it testing).
I just ordered a few more drives. I’m going to add a 3rd parity drive as well as add more drive space as I’m getting low. Starting next month I’m going to start ordering a new drive each paycheck to use strictly for backup. I’ll connect the drive, fill it and then remove and archive it (offsite).
By end of March I should have 4 parity drives as well as a complete backup on HDDs that are offsite.
While backing up to the cloud has worked well for me in the past/present it’s far to easy for any cloud provider to change their terms. I’ve gotten burnt by Bitcasa and MS Onedrive. Wouldn’t surprise me if Amazon was to do the same thing in the near future.
The issue is it’s constantly growing. I love bluray and always use uncompressed rips where I can. This plus a lack of money does not make a happy media consumer.
@lqvnguyen said:
The Seagate Archive 8TB are looking like the way for me to do cold storage backup of the new array being built. They are $200/drive so the price is not completely terrifying.
Where are you seeing them for $200? I’ve been seeing them at Newegg for $240 (haven’t googled them).
@danjames92 said:
The issue is it’s constantly growing. I love bluray and always use uncompressed rips where I can. This plus a lack of money does not make a happy media consumer.
You just have to assume you purchase 8TB at a time to get 4TB of storage. 16TB to get 8TB. Basically you factor in twice the cost for each purchase.
@lqvnguyen said:
The Seagate Archive 8TB are looking like the way for me to do cold storage backup of the new array being built. They are $200/drive so the price is not completely terrifying.
Where are you seeing them for $200? I’ve been seeing them at Newegg for $240 (haven’t googled them).
@danjames92 said:
The issue is it’s constantly growing. I love bluray and always use uncompressed rips where I can. This plus a lack of money does not make a happy media consumer.
You just have to assume you purchase 8TB at a time to get 4TB of storage. 16TB to get 8TB. Basically you factor in twice the cost for each purchase.
I have a 14TB raidz2 pool of which just under 9TB is used. I have 2 Seagate external 5TB drives which I WAS using to back up my library, but I have changed the file naming scheme, and haven’t done a back up in about 6 months, so I need to start over backing everything up again. In the future these will be kept offsite at my parents house which is less than 5 miles away. Should there be a disaster that destroys both the server and the backups at my parents, I will probably be dead anyway, but if I manage, not having my movie collection will be the LEAST of my worries.
Also, I (to date) only rip movies which I own and have in my possession, I don’t rip redboxs, etc. So those are backups too I suppose.
2 Newertech raid1 boxes for music (1 lossless, 1 320 kbs mp3), 1 Sans Digital raid1 for assorted video. 12TB movies, tv, concerts, etc. configured in MacZFS on my Mac Pro, of which 1 drive failed in 5+ years. Think it took about a day to resilver. Run a scrub every month (when I remember), no problems, runs like a champ.
I’d have to say, i use crashplan with the synology NAS platform. primary library is on a 4TB external drive which i will need to expand soon, and the backup sync is on a 48TB NAS.
I’m still looking for a good solution. My library is almost 60TB on a Synology DS2413+ and DX1211 expansion unit. Running 2 Volumes with 12 WD Red each. Using SHR2 with redundancy of 2 HDDs + 1 Hot Spare drive.
I started using Crashplan 2 years ago. But the connection to crash plan is so terrible slow… It would take 7 years to backup everything. I only get 2 MBit upload to the crash plan servers.
I wanted to try Backblaze, but they don’t support NAS volumes. So at the moment most of my stuff isn’t backed up.
@AgentMax said:
I’m still looking for a good solution. My library is almost 60TB on a Synology DS2413+ and DX1211 expansion unit. Running 2 Volumes with 12 WD Red each. Using SHR2 with redundancy of 2 HDDs + 1 Hot Spare drive.
I started using Crashplan 2 years ago. But the connection to crash plan is so terrible slow… It would take 7 years to backup everything. I only get 2 MBit upload to the crash plan servers.
I wanted to try Backblaze, but they don’t support NAS volumes. So at the moment most of my stuff isn’t backed up.
With a low upload speed like yours or mine using the cloud is not a good solution.
It is a bit pricey to start but the best/safest thing would be physical drives. You can buy a number of USB drives and run a backup program and fill them up and the store them somewhere safe or you can even have a separate drive array and backup nightly any changes to that. My library is not as large as yours but I use separate drives using DrivePool to get redundancy in my setup.
BTW: There are some on-line backup services that allow you to seed the backups by sending them drives that they then copy into their system and then send the drives back. I don’t know which services have that as an available option but it might be something to investigate.
I had 2x drives, one for TV Shows, one for Movies, and the movies one broke, so I lost my movie collection.
At that point I bought a Drobo USB RAID (specifically Drobo Mini), so now I have protection from single drive failure and all my media is on one device.
I realise that my collection is small compared to some of those listed above but the solution is scalable.
Drobo hardware highly recommended as you can increase the array size without having to rebuild it.
Online storage not practical for huge amounts of data, apart from anything else if everyone used it to back up their movie collection the Internet would have millions of copies of Avatar clogging it up on the off chance someone’s HDD fails, which doesn’t seem right does it? (By the way I know about data bit-pattern compression on corporate datastore, but that’s not the point).
Essentially if you are going to back up to the cloud you might as well just download new copies via bit torrents, probably faster.
Andy.
@BritishAndy you make good points all around.
The only thing I would say that might not be true is being able to find the same media again. If you torrent stuff you can’t always go back and find the same stuff a year from now. It’s volatile.
I used Crashplan for a year, but I had constant issues. I’ve since moved on to using AOMEI backup software installed on several PCs backing up to Drobo, and SOS Online Backup for backing up the Drobo itself. I’m happy with both products so far.
@tghowe said:
I used Crashplan for a year, but I had constant issues. I’ve since moved on to using AOMEI backup software installed on several PCs backing up to Drobo, and SOS Online Backup for backing up the Drobo itself. I’m happy with both products so far.
Thanks for that. Switched over to SOS and gave it a try. Super fast upload speed and unlimited plan (seems to be new? Haven’t found it some month ago).
Think I will cancel crash plan.
Are there any backup solutions out there that still offer mail-in HDD backup? I remember Amazon S3 had this a few years back. The pitchline was that you could do the initial backup by mailing them HDDs and then the subsequent additions would be done online…which solved the “it’ll take months” concerns about the initial backup.
@danjames92 said:
I don’t have a backup plan. Media is spread across 2 x 3TB drives and 1 2TB. It gets difficult when you have 7.4TB of media.
YOLO :))
7.4 TB of media is nothing. (Well not nothing but quite small) I have almost 18 TB of media and my library is quite small compared to many that post here. There are several folks with upwards of 30-40 TB of data.
With the prices of drives being as low as they and the difficulty of re-ripping and recreating libraries it really makes little sense to not at least back up the videos themselves. But that is entirely up to each person’s desires.
Whether local or online it is simply a good idea to backup any and all data that is not real easy to recreate.
Yea, 7.4 TB is easy to backup. Just pickup a Seagate 8TB Archive drive and call it a day.
I’ve got 2 independent backups offsite in the cloud.
I use Snapraid with 2 parity drives at present locally. So at present it would take a 3 drive failure for me to loose data on any one drive. In that case I can pull 1 drive worth of content down from the cloud in about 2 days (done it testing).
I just ordered a few more drives. I’m going to add a 3rd parity drive as well as add more drive space as I’m getting low. Starting next month I’m going to start ordering a new drive each paycheck to use strictly for backup. I’ll connect the drive, fill it and then remove and archive it (offsite).
By end of March I should have 4 parity drives as well as a complete backup on HDDs that are offsite.
While backing up to the cloud has worked well for me in the past/present it’s far to easy for any cloud provider to change their terms. I’ve gotten burnt by Bitcasa and MS Onedrive. Wouldn’t surprise me if Amazon was to do the same thing in the near future.
Any chance you would be willing to write a blog post or a forum post detailing how you use SnapRAID? I’m really interested in using it but I’m worried I would set something up wrong. I’d love some advice from someone that has clearly gone through the motions.
I’m using StableBit DrivePool for my drives but I’m not mirroring my videos as they are just too large. I would love to use SnapRAID for them if at all possible.
@jjross sure I can do this. I’ll add this in my “cayars” thread which is listed in my sig. I’ll try and get this done for you in a little while but should surely get it posted today.
I use StableBit DrivePool also so this should make it a “no brainer” for you to setup. BTW, I’ve had to use it a few times to recover data. Both for hardware (drive crash) and for “user error(s)”.
This “user error” mistake was very cool in the sense that since I hadn’t synced the parity I was able to recover my data. Had I been using any hardware/software that does real-time parity I would have been screwed.
@tghowe said:
I used Crashplan for a year, but I had constant issues. I’ve since moved on to using AOMEI backup software installed on several PCs backing up to Drobo, and SOS Online Backup for backing up the Drobo itself. I’m happy with both products so far.
I installed the SOS client on my Mac. But every time its doing a new backup run, it has to download ALL files from the NAS to calculate the hash. Even if the file haven’t changed. Thats ridiculous.
@cayars said: @jjross sure I can do this. I’ll add this in my “cayars” thread which is listed in my sig. I’ll try and get this done for you in a little while but should surely get it posted today.
I use StableBit DrivePool also so this should make it a “no brainer” for you to setup. BTW, I’ve had to use it a few times to recover data. Both for hardware (drive crash) and for “user error(s)”.
This “user error” mistake was very cool in the sense that since I hadn’t synced the parity I was able to recover my data. Had I been using any hardware/software that does real-time parity I would have been screwed.
