Hello,
I have around 3/4TB of photos (i store a JPG and a raw file) from maybe years. I just have them on a (external) 4TB HDD, and once a year i back them up to another (external) 4TB HDD (that i for the most part stored on the same location). I recently build a small homelab, just one old gaming pc. Now I and my family use Nextcloud notes, nextcloud contacts, nextcloud calendar, nextcloud phonetrack and more. I thought it would finally be a good time to transfer the photos to a ssd and use them with nextcloud so everyone can view the photos anyware! I run proxmox, so I want to buy one 8TB ssd (or 2x 4TB SSD Raid 0) and use it with something like truenas, to make it available for another proxmox vm where i host nextcloud.
Few questions: can nextcloud store this much? And will it cost any performance? The photos don’t really have any metadata, i just stored them in a folder structure like 2017 -> September ect, will this work with nextcloud? And the most important question: how can i make a GOOD backup system for this? I tought maybe a (encrypted) backup in the cloud, but its just expensive and i dont like the dependence. Any ideas?
Hopefully you can give me some tips and insights about how you would handle this. Thank you!
Nextcloud can easily handle 4Tb, I’ve seen guys with 50Tb instances with no issues
The backup problem is eternal. If you can, set up a consumer NAS somewhere else than where your server is and back up daily to it. Even over a slow connection, you should be able to get by after the first full backup.
If you can’t do that, either you go without backups and learn the hard way when your systems fail (I’m currently doing that, still waiting on the find out phase), or you will have to pay someone to store your data somewhere. From what I hear backblaze is affordable, but they do charge you per download. For 4 Tb, they would charge $180/year, with added costs per download which hopefully you can avoid.
A final alternative is to store cold backups somewhere else (at work, for example). Buy 2 external disks, and back up your server to one of them. Store it at work, then do the same with the other disk. Every month, rotate the disks. Your backup solution probably has a function to do exactly that, so you can leave one plugged in, accumulating this months data over time.
I haven’t noticed anyone else bring it up, but you mentioned in passing the possibility of using a RAID 0. I’d avoid that except in very specific circumstances. They’re potentially fine for a scratch disk type of scenario, but if any member of the array fails, the whole array is toast. The chances of a failure increases with was each disk added, so a RAID 0 is less reliable than a single disk. I definitely wouldn’t want to trust my family’s photos to it.
I run 120TB on a VM with 2 cores and 2gb of ram. Data storage is not very hardware intensive. Now serving the data to dozens of users is where you’re going to have issues.
Number of users total isn’t a big deal, number of concurrent users is. If nobody’s accessing them often it’s not particularly hard on your hardware either
I backup to Backblaze B2 (6$/TB a month), but I have much less data. I also backup all my data to another disk that lives in the same server. Id probably continue doing manual backups to external drive due to the cost of cloud backups
You’ll have an hard time with Nextcloud for that amount of files and total size. If you plan to sync better pick up something better such as Syncthing as it is robust, it doesn’t fail and handles tons of files with little resources, NC uses a lot more RAM and once you get to around 1 TB of small files it will stop working randomly.
If you just want a simple webUI to browser your files I would pick FileBrowser because it is very reliable and easy to setup. You can easily combine FileBrowser and Syncthing to have a cloud-like experience as well.
Sorry for my bad English btw
It never fails; Whenever I see someone apologizing for their ‘poor English’ it’s almost always essentially flawless (or, at least, better than the majority of native speakers anyway lol)
Thank you? I guess
ect
*etc., short for et cetera, Latin “and the rest”.
But native speakers do that all the time too. I don’t know how, because nobody ever says “ect” out loud.
deleted by creator
Cloud question:
Hetzner Storage Boxes.
Supports Snapshots. Create one every Day the last 30 days. Ez way to have another way of rolling back older backups.
Got 10TB available for ~24€.
Sync up there with rSync Protocol.
To be fair I am backing up from a Synology NAS so I am playing this in EZ-Mode :D
Don’t know how easy this is to setup on nextcloud.
