I want to create indexed and searchable offline SATA disk archives of all my data accumulated over 20-30 years of work. I have neither the time nor motivation to reinvent the wheel so I'm asking what comprehensive backup packages work well in Debian.
Requirements:
* must maintain a lite database describing media and its contents down to the file level, with possible annotations for backup sets and individual files.
* must allow backup to hot-pluggable SATA disks, as "disk sets" meaning that a backup may span multiple media volumes, and allow arbitrary and logical points where media is switched
* supports globs and meta-instruction files to ignore or schedule directory contents for backup (.ignore file, etc)
* save directories with huge number of files on media in TAR format, but still properly index the files
* datasets of 10-20TB.
* MUST HAVE GOOD DOCUMENTATION AND SUPPORT!!!
* ability to read and extract data from media directly, without going thru the backup system UI (requires media to be standard filesystem formatted, not raw block device)
Nice to have:
* selectable PAR2 recovery data on "safe media" to restore volumes that have degraded
* comprehensive CLI interface with GUI alternatives
Are there any pre-existing (active) packages that support all/most of the above? and no, I'm not interested in off-site or cloud storage.
Requirements:
* must maintain a lite database describing media and its contents down to the file level, with possible annotations for backup sets and individual files.
* must allow backup to hot-pluggable SATA disks, as "disk sets" meaning that a backup may span multiple media volumes, and allow arbitrary and logical points where media is switched
* supports globs and meta-instruction files to ignore or schedule directory contents for backup (.ignore file, etc)
* save directories with huge number of files on media in TAR format, but still properly index the files
* datasets of 10-20TB.
* MUST HAVE GOOD DOCUMENTATION AND SUPPORT!!!
* ability to read and extract data from media directly, without going thru the backup system UI (requires media to be standard filesystem formatted, not raw block device)
Nice to have:
* selectable PAR2 recovery data on "safe media" to restore volumes that have degraded
* comprehensive CLI interface with GUI alternatives
Are there any pre-existing (active) packages that support all/most of the above? and no, I'm not interested in off-site or cloud storage.
Statistics: Posted by kent_dorfman766 — 2025-01-07 14:11 — Replies 0 — Views 31