Recommendations for data backup solutions ?
from waterproof@sh.itjust.works to selfhosted@lemmy.world on 13 Dec 14:37
https://sh.itjust.works/post/51522817
from waterproof@sh.itjust.works to selfhosted@lemmy.world on 13 Dec 14:37
https://sh.itjust.works/post/51522817
Hello, so, I have been self-hosting some basic stuff recently, including data storage so i don’t have to rely on external services like google drive.
It’s working fine, but I wondered what would be the best backup solutions in case something unexpected and unfortunate happens (accidentally wipe out everything, drives dying, electrical issues, house burning down, that sort of thing).
I was wondering if more experienced self-hosters had recommendations about that ?
Maybe storing a physical drive in an especially sturdy box ? Perhaps using distant cold storage solutions ? Or even something I have never heard of ?
#selfhosted
threaded - newest
3 methods for me...
I wouldn’t trust the disconnected drives. They fail more often when offline than on, in my experience.
Granted it’s your 3rd backup, so it’s a smaller risk.
i spose...
my anecdote;
ive been runnin drives like this for 30 years. ive literally never had a cold storage drive go bad out of the case.. mostly because their hourly use rate is kept so incredibly low. even back in the day of very unreliable drives..
they even retain their data better than modern ssds
I have 2 powered RAID enclosures from icybox with 2 multi TB HDD in each one. The RAID is set to mirror the drives.
They are connected via usb 3 to a raspberry pi which runs borgbackup.
One is in my own place, just next to the main server.
The other is at my parents place in another city.
All my desktops, laptops and servers have borgmatic installed with the two pi’s as two targets. So when I create a backup it gets send to both locations. On my PCs I manually do a borg backup like once a month when I feel like it. The server computers are all on a daily schedule.
Borg has extremely efficient compression and defuplication. So having 20 historical snapshots of the whole file storage of each device takes about 30% less space than the original size on disk.
For example my desktop currently uses ~800GB but the borgbackup of said desktop takes only ~500GB.
The only disadvantage I find is that there is no cross system deduplication.
The super useful advantage is that I was able to just take the HDD enclosure, plug it into my Desktop and restore whatever files I want. I did an rsync to a blank fs once and it restored everything properly. And it’s pretty cheap. like 150$ total per backup location without any significant monthly costs.
I used hetzners storagebox for a while for borgbackups but restoring from it was SO SLOW. And my internet connection is not stable enough to do that without interruptions for multiple days. Never again, except for using it as an extra last resort “cloud” backup.
Depends on what you’re using as a platform. You should use something that integrates with it, like proxmox PVE and PBS
Depends on your paranoia/fault tolerance level. In general some form of the 3-2-1 backup rule. Personally I use arqbackup:
Anyone try Peergos ?
My server takes weekly backups via proxmox that are pushed to an NAS. The NAS backups and some additional files are copied up to filen.io for cloud storage. Probably not as professional as many of the setups you will see but it works for me.
Remember you aren’t just backing up the data but also backing up the hours of effort it takes to rebuild and get it how you want. If frequently backing up just the service OS you can store heaps for $2 on offerings like OVH cold archive.
Remove yourself from the backup you’ll forget or it will be inconvenient the week it blows up, so automate it, check the automation monthly. Don’t care that the 2nd cold backup takes ages if you have a quicker main backup.
Fireproof safes aren’t melt heatproof. Don’t rely on a local house backups for fireproofing.
I’m a self hoster, and hate subscription services but I believe cloud storage for use with a compressed encrypted backup makes sense.
Backup media and other stuff separately to avoid one large slow monolithic backup.
Veeam VBR (+NFR license)
Backs my
Windows PC
Several ProxMox VMs
Linux servers
to my NAS (NFS TrueNAS)
and on occassion an external HDD I keep at work.
1 of which is at home, the other at my work desk.
I’d consider paper (physical) backups for essential passwords and keys, but be careful about security.
In addition to the recommendations you’re getting already, I recommend learning about Borg Backup. It has great documentation.
www.borgbackup.org
Borgmatic is a project that makes automatic backups easier with Borg.
torsion.org/borgmatic/
If you want a GUI for your personal machines there is Vorta.
vorta.borgbase.com
I’ve used Borg for years now and test my restores every year. Which reminds me… I should do that more often. 😅