/hydrus/ - Hydrus Network

Archive for bug reports, feature requests, and other discussion for the hydrus network.

Index Catalog Archive Bottom Refresh
Name
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

Uncommon Time Winter Stream

Interboard /christmas/ Event has Begun!
Come celebrate Christmas with us here


8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

(1.59 MB 847x860 1425150841112.gif)

Remote backups with Hydrus Anonymous 01/20/2020 (Mon) 13:27:14 Id: c2f342 No. 13543
Hello everybody, I've been wondering how some of other Hydrus Network uses handle backups for their files. My current setup is like thus: I make weekly local backups of my database, which are then sent to a NAS through UrBackup, From there, I've been using Duplicati with cheap S3-compatible remote object storage. Now, supposedly Duplicati performs deduplication before uploading, however it still seems like it takes its sweet time on the SQLite database files themselves, so I'm wondering if their format just doesn't lend itself to be deduplicated adequately or if there is some other issue. I don't use password protection (although from what I've seen, it doesn't actually encrypt anything by itself so it shouldn't make much of a difference either way) So, what other methods do you use to backup your Hydrus files remotely? Ideally it should be with deduplication because although space is not at a premium for me, my upload speeds are very limited.
I'm a newbie at Hydrus and wanted to make a zip file copy of by Hydrus' database, so i can save all the files (and tag data too) and have a perfect copy hosted somewhere, in case my computer fucks up. And also in case i get a better machine with Hydrus and i want to get all my stuff back, specially without having to set up tags again.
>>13543 Would it not be safe to simply use Syncthing or rSync on the backup folder? Everytime you run a database update, it updates that folder. Then Syncthing/rSync just copies that file over to wherever remotely. This is an actual question, not sure if it would cause issues. I see no reason why it would though.
>>13543 Once a month, I make an encrypted 7zip archive of my entire database while Hydrus is closed. Then I slap it on a blu-ray and store it in an undisclosed safe location. This gives me an incentive to go through my inbox and keep my archive clean, because splitting archives to put them on separate disks is a pain in the ass and waste of money. I also have an automatic backup that does basically hourly backups, but it's to a drive that's always connected to my PC so I only consider it slight fuck-up protection. >>15078 If you did it on the backup, I don't see why it would cause problems. It wouldn't be encrypted though, unless the device you're syncing to stores it on an encrypted partition.
>>15081 >Then I slap it on a blu-ray Good luck when it reaches a bigger size. >t wouldn't be encrypted though, unless the device you're syncing to stores it on an encrypted partition. Always encrypt your backups in some way. You could even just rSync it to another part of your system locally, then encrypt it alongside anything else you want to backup, then have that encrypted archive be transferred remotely. I'm sure there's other easy ways, I just haven't dealt with backups much. I just backup to an encrypted drive every now and then locally.
>what other methods do you use to backup your Hydrus files remotely? run a hydrus client on a server and set it as a remote file repository, then you can tell your local instance to upload to it.
>>15078 I'm the anon from the OP, the main issue with this approach is that without deduplication of some kind, you'll end up having to send your (rather sizable) database file with every update all over again every time you rsync with the remote folder. As I mentioned last year, storage space isn't so much a concern as it is upload speed, as even with a mild recent improvement they still top around 2Mbps. I had to stop using Duplicati as it was incredibly fragile, I'm now using borg and rclone to send my local repo to a Backblaze B2 bucket (even cheaper than my previous option). Borg handles the deduplication and encryption.
>>15120 With something like borgbackup/rsync you can do it in a way that it only updates changed files I believe. So you're not backing up the entire db over and over, only changes.


Forms
Delete
Report
Quick Reply