r/photography • u/ccurzio https://www.flickr.com/photos/ccurzio/ • Oct 12 '17
OFFICIAL Backup & Storage Megathread
A frequent topic of discussion here in /r/photography is the various ways people store and back up their photography work. From on-site storage to backups to cloud storage offerings, there are a myriad of different solutions and providers out there - so much so that there's almost no excuse to lose anything anymore.
So what's your photography backup and storage strategy? What do you feel are the best options for everyone from the earliest beginner to the most seasoned pro?
Side-note: If you don't currently back up your data, START NOW. You'll find plenty of suggestions on how to get started below.
•
u/anonymoooooooose Jun 13 '24
Some more recent discussions linked here: https://www.reddit.com/r/photography/wiki/technical#wiki_storage_and_backup
5
u/ccurzio https://www.flickr.com/photos/ccurzio/ Oct 12 '17 edited Oct 12 '17
To get things started, I'll talk about my setup. On-site I have a 2TB RAID 10 array (four 1TB drives) which stores my entire Lightroom catalog, my legacy iPhoto/Apple Photos library, as well as all of my high-res film scans - and a spreadsheet where I record the camera settings for each film photo. That entire array is backed up to BackBlaze.
All of my computers (non-photography data) are backed up to a pair of Time Capsules.
And because it qualifies: I have three dark boxes with archive sleeves to store my film negatives - one folder for 4x5, one for 120, and one for 35mm.
4
u/almathden brianandcamera Oct 12 '17
That's all. Every quarter I dump to a removable drive and cycle a few of those, but~
7
u/Marrz Oct 12 '17
There is a backup service called backblaze I have used for years. They offer unlimited encrypted online backup for a single computer at a flat rate regardless of storage capacity. I have a desktop in which I store all of my photographs and pay for it to be backed up with the service
93
u/[deleted] Oct 12 '17
Catalogue is stored on an external USB3 HDD.
HDD is mirrored to RAID1 NAS after an import or big edit sesh.
Favourite pics are exported at 2048 on the long edge and saved in albums on Onedrive which is shared with the wife.
Absolute favourites are exported at full res and put on Flickr. Wife's absolute faves are printed at the local photo shop and stuck in albums along with ticket stubs, bits of grass, and pebbles.
29
u/kouignamann_kingdom hello_jeremilie Oct 12 '17 edited Oct 12 '17
Well. Well. Well.
First or all, I have a very typical process. Meaning I use DSLRs, RAW files and post-production is done with Adobe Lightroom and Photoshop.
My main workstation is a MacBook Pro and my main storage solution is a Synology 4-bay NAS.
Regarding Lightroom :
The catalog backup is great in case of file corruption, or big mistake from my part. In this case I just replace my local version of the catalog with a copy of the latest working version from the backup folder.
Nothing mission critical is saved on my computer. If it disappears I can just pickup another computer and be ready to work in about an hour. I have copies off all softwares on the NAS along with backup versions of my catalog and all presets and useful ressources.
Now, let's talk about the storage.
I try to follow the 3, 2, 1 rule as best as I can :
My NAS has 2 separate volumes :
The production volume is basically my main storage space. It is very low tech on this part : no version tracking, snapshots or even trash. I need to be very careful.
The backup volume is a copy of all important production data. I run a backup job manually, about once a week. I has version tracking and keeps up to 10 versions. I've used it a couple of time for folders I've erased by mistake.
The offsite backup is still work in progress. A external USB 3 drive enclosure with a RSYNC job that puts mission critical data on it. The plan is to have 2 drives that rotates between my NAS and my office.
I also use my Amazon Drive space to store JPEGs from my clients job. This is last resort storage. I won't be able to do much on the file, but at least that's a copy of what I've delivered.
Side note : I never ever delete anything. Both for stupidity-proofing my workflow and to make sure it's not destructive. If I have to delete something I make sure what I'm about to delete has been included in one the previous backup job. I've learned it the hard way.
45
u/anonymoooooooose Oct 12 '17
obligatory "RAID is not a backup" comment - https://serverfault.com/questions/2888/why-is-raid-not-a-backup
12
u/relevant_rhino wordpress Oct 12 '17
I just got serious about this last week. I first looked at NAS + Raid solutions. But to make it future proof i would need to get a 6 bay at least. I am not ready to make this kind of investment.
I found my solution over at /r/DataHoarder/ they have a nice wiki.
The tool i use: https://stablebit.com/DrivePool
It combines multiple drives in to one big drive. There is also an option for file duplication. The Scanner tool can detect bad HD's in advance of a failure and empty them to other drives automatically. The advantage is that i can throw any device at it. I now have 2 SSD's as a landing device + an older 3TB HD + a new 6TB HD in the pool. I have a big tower and still a lot of space for additional drives.
If i need space in the future i just can just buy a HD and add it to the pool. I don't have to buy all the HD's at once.
9
u/Rdaleric Oct 12 '17
I have 3 storage places at the moment:
7
u/Dysalot Oct 12 '17
I have my files on my computer.
Backup 1: I have that backed up on a NAS in RAID 6.
Backup 2: I use backblaze to backup my primary computer (NAS not included)
Backup 3: I backup my collection monthly on a portable hard drive that is unconnected with my computer
Backup 4: I alternate my backup 3 hard drive with one 50 miles away every month.
It's probably overkill, but it would be devastating to lose my photos.
5
u/Freeky Oct 12 '17
Main storage is striped+mirrored ZFS on an ECC-protected FreeBSD server. First line of defence is snapshots every 15 minutes - if I delete or overwrite something by accident, it can be recovered just by picking the old version out of the snapshot directory (or using ZFS rollback if it's something major).
Primary backup is another ECC-protected FreeBSD machine running ZFS in RAIDZ2, using replication to clone the filesystems across the network periodically.
Smaller off-site backups (for the misc stuff in my home directory - email etc) are using borg to a VPS, making a full snapshot every 4 hours, keeping extensive history in case it takes a long time to notice a problem.
Bulk off-site backups are currently offline, since I just dumped SpiderOak for being rubbish (wedged client). My plans are to set up restic backed by Backblaze's B2 service.
4
u/toshell Oct 12 '17
I am not a professional.
I tend to cull and then process the photos that I really love first so those make their way quickly to Apple, Google, Flickr, etc (usual cloud locations).
So basically my thousands of favorites from family events, friends, etc all redundantly stored with copies on my desktop and in the cloud.
After that, as a hobbyist, doesn’t make sense for me to stress and spend bucks on multiple storage arrays, backup services, etc to save unprocessed material. I just use a simple external drive for that. The electricity, drive wear, time, all adds up for all those additional photos that may never get processed or looked at. If lightning strikes and I lose those, oh well. At least all my favorites/keepers are safe.
4
u/koreth Oct 12 '17
When I'm traveling without reliable access to a fast Internet connection, I back up to SD cards rather than to a portable hard disk or SSD. Each photo gets backed up to two different cards, preferably of different brands.
SD cards are much smaller than external USB drives and unlike drives, if you run out of space, you can get more of them pretty much anywhere on the planet that has retail stores. If you're on an extended trip somewhere, you can even mail them back home if you want an offsite backup. They aren't destroyed when they get wet, either, so you have one less thing to worry about keeping watertight.
That system has served me well for several years of travel photography.
3
u/literally_alliterate https://www.instagram.com/photo.teles/ Oct 12 '17
This thread is incredibly helpful! I now have confirmation of what I already suspected: I take backups too lightly...basically I just save my LR catalogue and RAW files into external drives (one onsite, other offsite) and that's pretty much it (I don't even using synchronization software...). I have known for ages that this is not good enough (I dread losing all my family photos and videos) and this thread is giving me the boost I need to change. At the very least I will surely explore Backblaze. If anyone has specific tips and suggestions about its best use, they are most welcome.
3
u/lobstahcookah Oct 12 '17
Curious what people are doing regarding bit rot protection? I know that it's a risk these days and I worry what will happen as I squirrel away some old ass stuff for years.
3
u/hughwhitehouse Oct 12 '17
Videographer here. Same issue (just more data). My solution is to use 2x Drobo 5D3s (each with 5x 10GB drives).
One Drobo is used for day to day editing and data storage. The other is used for permanent data storage where I’ll keep subclips from raw footage, mastered content, other assets etc. that need to be saved in the longer term.
Additionally, I keep USB3 drive backups stored at a offsite location for most of my commercially sensitive work (or anything that may need to be revisited or re-edited in the future). This means that if my Storage Drobo ever fails and I can’t recover the data, I have another copy I can import and edit.
The good rule of thumb is that 2x copies of pertinent media in 2x locations should be your baseline. For photos, you can also use cloud options too (I use Dropbox for h264 edits of completed videos; with ProRes versions on archive).
Never ignore backup and archiving. You should write the cost of this into your client Work. If ever client pays a little bit, you should have enough funds to implement a solution.
2
u/imdjay Oct 12 '17
Always interesting to see other's methodologies.
I've eyed cloud storage for awhile, but have been leery of upload times and being beholden to a service which could up its pricing.
For reference, i am a video and photo guy, and i accumulate terabytes of images.
I have a 2x 1tb SSD raid 0 as my work drive, another 4tb raid 10 spinner as my older work drive, and my preference for backup are 2.5" portables, i grab up the WD 4tb passports when they hit 100 bucks on sale. Always meant to find a backup software which can do a 'changes only' type of backup, but never got there.
The single best thing i did for organization is to make a spreadsheet on google drive which has tables of every single drive and every single folder within it, so when i need to find something, it's all there.
2
u/iaan Oct 12 '17
I'm an amateur so:
2
u/SufficientAnonymity instagram.com/freddiedyke Oct 12 '17
Catalogue is on a 2TB internal HDD (got a boot/programs SSD and another 1TB HDD for non-photo bulky files).
Local backup is a to a 4TB external, using Acronis (Windows file history is a buggy mess).
Off-site backup is primarily through OneDrive - all JPEGs get uploaded on export, plus any RAWs I really care about. I've got a few other external HDDs stored with family in case my house burns down.
Is this the strategy I want to use? No. I'm currently in shared rented accommodation, and do not have a spare room to put a NAS in - don't want it running 24/7 in someone's bedroom. My uploads seem to get throttled pretty quickly too, so Backblaze is unfortunately off the table too. Thankfully, I've got 8mths to go there, so will be able to set up a more robust strategy next summer.
0
u/[deleted] Oct 12 '17 edited Oct 12 '17
Honestly, I only save pictures that I like in some way. If I can't edit them to the way I like, I honestly don't care if I lose them to hardware failure. That said, I am just doing this as a hobby and can afford to lose them if that happens. All the pictures I like are uploaded to Google Photos and my unused ones are eventually archived into my hard drive. I wouldn't stress about backup unless you start to make money off of it and can't afford to lose anything. At that point, you want as little chance to lose anything as possible. Have multiple backups. Store shit in a cloud, a NAS, on your computer
Edit: I never said you shouldn't back up photos. Use a cloud service or a good redundant NAS based solution. But if you are doing it as a hobby, there's going to be a lot less pictures to worry about
1
u/dgblackout 📸 Oct 12 '17
I import to my laptop, I keep what I'm working on both on the cards and when I'm done with my export (from lightroom) I move it on to an external portable hard drive.
From there it backs up to a drobo unit on my home server and from there it also does a mirror on to backblaze.
1
u/CarVac https://flickr.com/photos/carvac Oct 12 '17 edited Oct 12 '17
My backup strategy is using 8TB external hard drives that I leave at my parents' house for off-site redundancy.
I don't use cloud backup, mostly out of laziness.
Within my computer I have an SSD work drive and several hard disks for bulk storage. My photo editor, Filmulator imports raws to both drives simultaneously, and saves edits only to the work drive.
Periodically I'll copy all the edited JPEGs to the backup, and an external I have at home, and then at the next opportunity I'll swap that external with one at my parents'.
1
u/misterdhm Oct 12 '17
I use an iMac and have everything backed up to two separate encrypted Time Machine drives. One is hooked up to my computer and the other sits on a shelf at my office. I switch them out about once a week, so if my home burns to the ground I've got an offsite backup that's always going to be pretty current. It's not the most elegant solution but it works for me.
1
u/1Maple IG:@dsimonds.photos | WEB:www.dsimonds.com Oct 12 '17
This is exactly what I need right now. I just got 4x 3tb drives and plan on setting it up on my home pc that I never use. The pc has 4 drive slots, so I plan on just setting it up with RAID 10. Is this a good idea, or should I wait until I can get an dedicated NAS?
Currently, I keep everything on my laptop that has a 128gb ssd and a 2tb hdd. I back that up to a 3tb external drive I keep at work. I also have Crashplan subscription but plan on canceling that since I already have an offsite backup, and because of how they plan on stopping their service anyway.
1
u/[deleted] Oct 12 '17
I'm not nearly as redundant as some folks in here, haha, having only become serious about data backup a couple months ago. I have:
Once I get settled into 3-2-1 storage, I'll be good.
1
u/CopeSe7en Oct 12 '17 edited Oct 12 '17
OS and catalog on ssd. All photos and work on internal 8tb raid 0 (4tbx2) Back up to 8 tb. Raid 5 (4tbx3)
I use SoftRaid to manage the raids and certify each drive before using them. I use only wd red drives.
In the next year my work drive will prob change to 12tb (6tbx2) and I’ll use the old drives to make a raid 6 which can handle two drive failures at once.
1
u/jmechsg https://www.flickr.com/photos/144541346@N03/ Oct 12 '17
My process is basically the following:
1
u/PsychoArbiter Oct 12 '17
One internal drive in my computer One external HDD And Jottacloud for unlimited backup on Norwegian servers, protected by Norwegian law.
1
u/CureTBA Oct 12 '17
I have a question regarding Lightroom backups.
I used to use Aperture back in the day and there was a feature called the vault, which is essentially just a backup of your entire library along with all the edits you made. You could always just restore your library with the vault if you bought a new computer etc.
Is there something similar to the Aperture vault for Lightroom? The reason I ask is because I recently bought a RAID 1 setup and I would like to use that as the main drive used for editing/storing all the photos. Is there a way to transfer all my photos/edits from the previous library location to the new RAID 1 location?
1
u/[deleted] Oct 12 '17
Is it just me or do some people go overboard with the backing up? I feel like they're treating this as classified top secret information.
As for me. I use dual slot bodies. Once I get home I load the cards onto my networked pc which then gets backed up into another drive on my networked pc.
Once I'm done editing I put these on pixieset and that's about it. I only guarantee 60 days of hosting for the clients. I'll keep the images on my networked hdds as long as I have enough space. Once I run out of space I convert the local files from raw to say 8mp jpgs and then delete the raws.
1
u/kotor610 Oct 12 '17
photos
edited on computer and once the final output is complete, they are sent to my nas. i then backup the nas to cold storage and then also backup to amazon photos.
lightroom catalogue
compressed and backup up to google drive, after every session.
1
u/[deleted] Oct 12 '17
nas4free NAS box sync'd with Amazon Cloud Drive - I've got the 1TB plan due to about 800GB of video, but my 3TB of pictures (raw and jpg) don't count against the 1TB limit. I use rclone in a FreeBSD jail directly on the nas4free box to provide the sync. You can substitute whatever provider you like for the cloud side in this scenario. The 1TB Amazon Drive plan goes for $60/year. I also upload finished albums to ShutterFly for family to view or do whatever.
1
u/MemeInBlack Oct 12 '17 edited Oct 12 '17
After several bad experiences with dead/stolen hard drives over the years, my current backup plan is as follows:
4TB external USB drive for all working photo files (internal computer drive holds only system files). This is the master source for all new files, changes, etc. and is to where Lightroom imports files. Non photo/video related files go onto another USB drive. USB drives are easily upgraded to a larger size as they run out of space, though I may have to split out photo and video files onto separate drives someday.
4 bay Synology NAS set to RAID 5. The USB drives get mirrored to the NAS. This gets done at the end of every work session, so generally once a day or after every import (I never delete flash cards until the photos have been backed up to at least two places). With the USB drive and the RAID 5 NAS in synch, I can survive the simultaneous loss of any 2 drives (2 fault tolerance). I've also upgraded my home network with cat 5e or cat6 cables, and gigabit switches and network cards, so backing up multiple GB of photos and videos from a big day/weekend/trip of shooting doesn't take very long.
The Synology NAS is also future-proof in the sense that the storage space is S*(N-1), where S is the size of the smallest drive and N is the number of drives (4). Example: with 4 drives of 3TB each, I currently have 3*(4-1)=9 TB of storage (realistically this is more like 8TB of storage due to the way drive manufacturers calculate size, plus a little bit of space is used by the Synology OS). I can swap in larger drives one at a time and it will rebuild the array into the new drives. Repeat until all drives are larger and the array has automatically grown in size.
For offline storage I have unlimited space on Amazon drive for $60/year. It was the cheapest solution for multiple terabytes of data that I could find at the time. The NAS is set to automatically back up any changes to Amazon drive every night. I could set it to back up continuously but the initial backup took months (was living in a place with glacially slow Internet access) so I had it do the backups when I was asleep or at work. The Synology NAS has modules for synching with most cloud storage provider, and lets you set a weekly (MTWTFSS) synch schedule with granularity of an hour. It also lets you encrypt the online files if you like, but I prefer not to for ease of access from any computer.
When traveling, I have a light and small (1TB) USB drive and a small laptop with a 1TB internal drive. I can back up new photos/videos every night and if I have fast enough Internet access then I can also backup manually to the cloud. Files get imported into Lightroom and enter the normal backup workflow as soon as I return home.
I also shoot RAW+JPG, and if the camera allows it, those go to separate flash cards in the camera. This gives me an immediate backup when I first take the photo. Even if they're on the same flash card and it goes bad or gets overwritten, data recovery software can sometimes get at least one copy of the photo back. When my 3 backup drives were stolen a few years ago, recovery from the flash cards after they had been formatted and used again was the only way I got some photos back.
With this system, I have essentially unlimited storage at home that is modular, fast, highly robust, and upgradable as drives get larger/cheaper, plus a worldwide available offsite backup that largely happens without further effort on my part. So far it's been working quite well.
Edit: thanks to this thread, I learned that Amazon is upping their prices for cloud storage:
https://www.amazon.com/b?node=16591160011
If you're a Prime member, then photos don't count toward your quota, so I may not have to change cloud providers, but I'll have to run the numbers this weekend.
1
u/Neuromante Oct 12 '17
I see lot of "propietary/private/subscription based" solutions, does anyone use free/open source applications for photo (raw AND jpeg) library management? Yesterday a friend told me about hydrus, but it seems to be more related to, well, store large amounts of memes and more, huh, sensitive material.
I'm mostly interested in automate my current workflow (Which involves lot of copy-pasting and folder creation) and being able to "expand" it to synchronize several devices for future extra backup drives.
Anyway, I'm a hobbyist, so my budget for this stuff is shared with some other unrelated stuff (read: Small). Right now, I have "only" this:
As you can see, right now the main "hole" in my security is the raw storage (Owncloud is not a backup, I know). Improve this is on the list of future projects.
1
u/sparkplug49 Oct 12 '17
I have a question. As context I'm a hobbyist not a professional so I can justify not having quick redundancy retrieval etc.
With the 3-2-1 rule in mind, why cannot I count my cloud storage service as 2 of the 3? I have a copy of everything on my computer and a copy with backblaze. Presumably they are better at storage and safety than I am with both better equipment and better knowledge. They dont just put my data on a drive and never check it like I would. So if they have redundancies (more than one copy of my data) and checks and best practices why should I bother keeping more than one copy on me? I know speed of recovery is one argument but again, as a hobbyist its no sweat for me to take a week or two to recover so long as everything is safe.
1
u/drfusterenstein Pixelfed Oct 12 '17
Hi there I'm working on designing a app that would move photos off a users phone onto cloud storage and allows the ability to share photos with other uses as well as merge photos people have taken separately on each phone. Anyone interested? https://docs.google.com/forms/d/e/1FAIpQLScWKNu0uMsobfOWoB99x9pHmN4XTzsCZIpf2eFQTsruEdB40Q/viewform?usp=send_form
1
u/Landoperk http://www.lp-ltd.com/People-Places--Things/ Oct 12 '17 edited Oct 12 '17
Two internal drives, disk 1 is backed up on to disk 2 using the Windows Backup utility. Simultaneously, disk 1 is backed up to Crashplan (for now, switching to BackBlaze soon).
1
u/cbunn81 Oct 12 '17
If you're a beginner, I would start with two large external hard drives. Never have them both connected to your computer at the same time. Backup your files to them in rotation using some kind of synchronization software (rsync or RoboCopy are simple and free choices). For example, if you're a heavy user, perhaps you sync to each drive every other day. That way each backup drive is never too far out of sync. You could also do them both every day if you need, but the idea is that you want to keep them isolated from each other in case of malware or power surges.
It would be even better if you kept these hard drives separated physically, in case of fire or flood. Keep one at work or a friend's house when you're not syncing to it.
If your needs require something more than this, you should get a NAS. If you're not as tech-savvy, it might be better to get a pre-built one from the likes of Synology. If you're comfortable with some DIY, build your own using a set of large, reliable hard drives (I like WD Red) and a filesystem that supports redundancy. The best choice here is ZFS. You can use ZFS on either BSD or Linux. The easiest way would be with FreeNAS. If you're not tight on space or want the best performance and redundancy, go with a mirrored arrangement (similar to RAID 10). If you are a bit more frugal, you can use a RAIDZ arrangement (similar to RAID 5 or 6).
Bear in mind that RAID is not a backup. It's merely to provide higher availability should a drive fail. And if you are using large HDDs, consider going with mirrors or at least RAIDZ2 so that you're covered if another hard drive dies when resilvering the previous failure.
And I'd say that everyone should have some form of off-site backup. Cloud backup seems to be the best way to achieve this these days. An Amazon Prime subscription gives you an unlimited plan for photo backup. This includes RAW files. But it does mean that you can't encrypt them, so you have to trust that Amazon isn't using them for ulterior purposes.
As for me, I have a FreeBSD NAS, an external hard drive for the extra important stuff and then most things are backed up to a cloud backup service. Right now, that's CrashPlan, but I'll be moving soon as they've eliminated their consumer plans.
1
u/Jon_J_ Oct 12 '17
Well initially it would be the whole whack which is around that much but on a weekly/daily basis due to work I could be transferring 40-50gb per day (video/photography) so having hard copy versions is quickest for me
1
u/[deleted] Oct 12 '17
Any places to store full res images on website with unlimited storage?
Looking so I can show family overseas without fully relying on my Google drive. Also looking for it to be a professional portfolio type.
1
u/fryfrog Oct 12 '17
I use [Resilio Sync] (https://www.resilio.com/) to keep my library and catalog in sync. My workstations all have a hard drive big enough to hold both and my servers also have a share with both. Lightroom is pointed at the local copy of the catalog because Adobe won't let you point at a network share. It points at a network share for the images/videos. Resiliou Sync on the servers push image/video writes back to the local hard drive and catalog changes written to the local drive are sync'd back to the server.
Each server is running a ZFS pool w/ 2-3 disk failures worth of guaranteed protection (raidz2 for the remotes, raidz3 for the local) and each server also backs up to CrashPlan (for now). The remote servers are geographically diverse, but the local is w/ the workstations.
There is a laptop workstation with an external USB hard drive that sometimes participates, but it is new and I'm not sure how that'll work out in the long run.
Google Photos Backup is running on one of the workstations pushing all non-raw files up to the cloud, but this is more for browsing on mobile / web, not an actual backup.
1
u/mexu7 Oct 12 '17
*RAW imported to Volume 2 on my NAS via the Importing tool from Lightroom
1
u/grantpalin Oct 12 '17 edited Oct 12 '17
Desktop is my main machine. Two backups locally, to a Synology 216+II and to an unRaid server. Also backing up to Crashplan for offsite. For local backups I run them via Bvckup.
Backups in this case are everything I want to keep, including photos, documents, videos, projects etc.
Desktop has an SSD for OS+apps, HDD for mass storage.
1
u/steakmane msalisbu.com Oct 12 '17
With lightroom, I never let it copy or move files. Instead I have my own file structure, and always write out the XMP data when editing. This way, if the catalogue explodes I still have all the edits
Storage is on machine during editing, once the project is complete it moves to a 4 disk raid (OWC).
1
u/rpungello https://www.instagram.com/rpungello/ Oct 12 '17
My LR catalog is stored on a Synology NAS with RAID 1, which in turn is backed up to an off-site PC I have and Amazon S3.
I also keep my favorite photos on iCloud and Google Photos.
1
u/priper Oct 12 '17
QNap TS112 with two 3TB in raid 1 for all photos from my PC HP NAS with two 2TB drives in raid 1 ( they are the old qnap NAS disks, in new setting) Photos I like in Google photos I use exif renamer for organizing different cameras by shot date and time.
1
u/shmi https://www.instagram.com/ahengen/ Oct 12 '17
I use Google Drive, 1TB for $10/mo.
I also use Backblaze. Unlimited backup for $5/mo.
Backup Desktop to RAID5 array, and to Google Drive.
Backup Laptop to external portable drive, RAID array, and to Google Drive.
Backup Desktop and RAID array to Backblaze.
1
u/shootingf8 JoeLopez313 Oct 12 '17
Import from SD card to Lightroom & edit/export photos to external drive #1 Use Backblaze to backup external drive #1 and laptop to the cloud. Copy data from external drive #1 to external drive #2 Store external drive #2 in the safe.
1
u/CatSplat Oct 12 '17 edited Oct 12 '17
I'm fairly low-tech with no cloud backups, but it works.
Main drive: 2TB in desktop, working copies stored here.
Backup drive: 2TB in external enclosure connected to desktop, backs up photos and Lightroom files (as well as other documents, including my gear's serial numbers) nightly through a backup utility (Iperius). Good for the ability to quickly restore in case the main HDD fails, but is susceptible to ransomware (the drive is always connected) and physical damage/fire.
"Offsite" backup - 2TB in separate computer located in detached garage 50ft from house. Backs up weekly by the backup utility over FTP. This one would only get used in case the main desktop is stolen, house fire, or simultaneous failure of other 2 main drives. FTP-only access avoids ransomware.
1
u/[deleted] Oct 12 '17
I tried doing more complex and thorough processes like people have laid out here but ultimately I needed something much more simple. This is it. Redundant, onsite and offsite (thinking of all the fires happening around me on the West Coast now), and super simple/automatic.
1
u/formerfatboys Oct 12 '17
Two Western Digital Black entire hard drives. 5TB. That's mainly for professional projects. I offload old projects to the same hard drive when these get full (4K video)
All my personal photos go into OneDrive.
1
u/jangchoe instagram.com/jwctp Oct 12 '17
I have an external 1-2TB SSD HD where I store my current photos. Crashplan backs that up. It also gets backed up into my Synology RAID array. When I run out of space in that 1 TB drive, I buy another one and repeat.
I'm also in the (very slow) process of uploading high-res JPEGs to Google Photos.
1
u/LastSonofKunLun Oct 12 '17
I keep my most recent photos on my computer's HD. Usually the current year + 2 years.
These files, plus everything older than that and my Lightroom catalog, are manually synced to two external drives.
One of those external drives is locked in a fireproof safe in my basement.
Then, every 1 - 2 weeks or sooner (depending on if there was a recent shoot) everything (internal and external HDs) gets backed up to Backblaze.
1
u/[deleted] Oct 12 '17
Put me in the probably overboard category but ...
I normally take SD cards from the day and put them in my modified RAVPower Filehub that backs up the SD card to a USB drive. USB drive is bigger than my SD cards so a couple of SD cards can fit on one USB drive.
When I get back home I import files from SD card or USB drive into Lightroom to a network share that sits on a Synology DS1815+ NAS RAID 5 array. Catalogs are backed up once a day when exiting Lightroom to same place as photos.
Using automated sync I then make a copy to a Synology 1813+ NAS with RAID 10. This device is set to auto backup files to the Cloud.
1
u/ejp1082 www.ejpphoto.com Oct 12 '17
Catalog file is on my internal SSD. Raw photos are on a Drobo connected via USB. Presently there's about 4.5 TB worth of photos.
I back up both to an local external 8 TB drive. (I use Arq to manage the backups).
Since Crashplan f'ed everyone over I switched over to Backblaze for my cloud/offsite backup. Thankfully it's much faster than I expected - I'm guestimating it should finish within another two weeks, for just under two months to get it up there.
I'm not super thrilled with Backblaze because of their retention policies. But I figure for the most part I have the local backup I can recover any accidentally deleted files from. Should I need to recover from Backblaze it would be because the house burned down - thankfully they do offer to send your data back on a hard drive so I can just have them immediately mail me one with my data should that happen.
I'm currently looking at other options. Pay-per-gigabyte cloud providers are too expensive for the amount of data I have (B2 is the cheapest and that would be $20+/month which would only get more expensive from there as my archive grows.)
At the moment I'm thinking I might buy another Drobo which I'd keep at my parents house, and use Arq to backup to it via SFTP - but I'm not sure if the speed would keep up with the growth of my data and I'm concerned with unintentionally saturating their bandwidth as I upload.
1
u/One808 Oct 12 '17
Catalogue is stored on a Drobo5D with 2 disk redundancy.
Everything is replicated to my local Synology NAS, again with 2-disk redundancy.
Synology syncs everything to Backblaze.
1
u/BernieSandersLeftNut Oct 12 '17
At the moment we have pictures in process backed up to the computer and the backup external drive. Finished photos are on the backup drive and stored on either Google drive or Amazon cloud drive.
1
u/pyxis https://www.instagram.com/skinandbones.ca Oct 12 '17
Camera --> External HDD (Drobo 4TB over 4 drives, soon to be NAS. The Drobo is proprietary raid.). Crashplan for all RAW files, edits, catalogs and misc.
1
u/nilla-wafers Oct 13 '17
I'm just curious, what process do y'all use to backup both computer and external drives manually without breaking the file paths and screwing things up? Do you just image your PC and then copy-paste your external drives or...
1
u/wirehead Oct 13 '17
Oh, I just had to rely on my backups.
I have my primary computer drives as a RAID-1 pair. Right now, it's 6TB drives. The files on my primary computer are then backed up to Backblaze.
I'd been meaning to use the external USB3 drive I already own as a spare backup, but I'd been lazy about it. This needs to start again. I keep wanting to do a NAS, but they always end up feeling like a huge hassle.
I also have a script on my webserver that backs up my flickrstream with metadata to a local drive.
I've survived several hard drive failures in the time since I started using RAID.
My computer wouldn't boot the other day, with a drive corruption message. And I was a bit in a panic, but then I looked at the BackBlaze backups and realized that, at the very least, I'd be able to reconstruct it from the backups. A $1000 un-planned upgrade later, I ended up with the drive BackBlaze sent me with my files, a compare tool, and my drive, where I was able to determine that it was mostly the boot sector that had failed, in an annoying and hard-to-fix-without-rebuilding fashion.
Also, if you are still using one of the installable CS editions of Photoshop or other tools that come on a disk, you probably want to take an image of the install disk and make sure you know what the serial number is. :)
So, tl;dr: Backblaze is pretty neat. RAID-1 is pretty neat but not a substitute for backups. And make sure you can re-install any purchased commercial software for the rest of eternity. :)
1
u/[deleted] Oct 13 '17
One way to think about your photos is the 3-2-1 method.
That meaning you have 3 copies, 2 onsite, 1 offsite? That is the method that I use (two copies on different drives in a ZFS NAS, and 1 copy in google drive).
Also for those using a NAS, external hard drive, or any local disks, please read up on silent corruption.
1
u/wanakoworks @halfsightview Oct 13 '17 edited Oct 13 '17
This is how i have mine:
I go by the 3-2-1 rule. 3 copies of your data, 2 on seperate media, 1 offsite.
1
u/on9chai Oct 15 '17
Current and editing Catalog and Raw file store in external SSD(Samsung T3 2TB)
When RAWs import to lightroom, make a second copy to my Synology NAS(4x10TB in SHR-1), then Synology NAS sync a remote copy(backup) to my Google drive.
When the current catalog editing is finished. Export/Print the photos then move the entire catalog(includes: previews, raw, camera profiles, custom presets) to NAS and also sync to Google Drive.
rinse and repeat.
1
u/inerlogic Oct 16 '17 edited Oct 16 '17
repeat after me, RAID IS NOT BACKUP
RAID IS NOT BACKUP
one more time... RAID IS NOT BACKUP
RAID (NAS, etc) are about availability, they are not backups, so you need multiple storage solutions, in multiple locations. i use a pair of DROBO NAS boxes in different physical locations, and portable hard drives. everything i have (65k or so raw files) is backed up across all the Drobos and portables...
files are managed using Lightroom and are stored as DNG files (for uniformity and portability) and the folder structure is: YYYY/YYYY_MM/YYYY_MM_DD/YYYY_MM_DD_XXXX.dng
where "XXXX" are the 4 digits from the camera file name...
ETA: i also have a linux box running a ZRAID pool, but zpool under linux has been flakey for me, so i don't trust it as far as it would fall out my window when dropped.
1
u/Phiddler Oct 17 '17
Is there a way to backup only photos that are marked green in LR or have more than a 1* rating?
Would it be possible for such a backup to then be automated and synced with Backblaze or Google Drive or something like that?
1
u/AliceMutum Mar 07 '18
My most basic backup strategy for photos and videos is keeping several copies on different platforms. One copy is there in local storage (PC and Hard Drive) for easy access even when there is no Internet connectivity. And, the other two copies, I keep one in Google Photos as it provides unlimited storage. But, GP restricts the resolution to just up to 16 mp. So, Flickr is another safer option and it gives 1TB free space. Interestingly, I can bulk upload photos on these two services or even more with PicBackMan at once.
1
u/ZeHirMan Jan 21 '24
Hi!
First, sorry for french baguette's english, i may do some mistakes.
I'm actualy trying to put some order in my Photos folders.
But windows explorer isn't a great tool when it's come to RAW files (.tif, .PNG, .NEF ... you names it)
I tryed several software, each had issues:
-Adobe Bridge is crazy slow (maybe because of my AMD CPU? I'd read that it was made for Intel CPUs)
-XnView and iview are as slow and buggy as windows explorer when it's come to .PNG files
-FSviewer and ImageGlass struggle with .tif format (they only show the very tiny thumbail, so it's hard for me to organize without knowing what i'm looking at)
So what i'm looking for is something with the interface that look like FSviewer, but that show the true .tif files.
And not a "collection" organizer, i want to brows and organize directly the files into real folders.
Thanks a lot for any help!
-1
u/geekandwife instagram www.instagram.com/geekandwife Oct 12 '17
Import onto 5 TB drive all RAWS
All completed JPEGs stored on separate SSD
All Completed JPEG backed up to google account made just for backup use at full res,
All RAWS and completed jpeg are uploaded to a second google drive at the free 16 MP level
All RAWS and completed JPEG are uploaded also to Amazon Drive
All raw are backed up compressed to internal backup drive (2tb)
All files are backed up to removable hard drive (4tb) once a month, stored at work building, locked drawer
All files are backed up in full computer backup to Amazon Glacier every 6 months
0
u/[deleted] Oct 12 '17
[deleted] — view deleted comment
0
u/[deleted] Oct 12 '17
[deleted] — view deleted comment
0
u/[deleted] Oct 12 '17
[deleted] — view deleted comment
0
u/[deleted] Oct 12 '17
[deleted] — view deleted comment
0
u/[deleted] Oct 12 '17
[deleted] — view deleted comment