This is good thinking, but I think you are basically describing a Restic/Borg re... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Intralexical 7 months ago \| parent \| context \| favorite \| on: Tell HN: Deduplicating a 10.4 TiB game preservatio... This is good thinking, but I think you are basically describing a Restic/Borg respository :) - Deduplication? Check. - Compact format? Check. - Good read speed? Yep. (Proportional to backing store.) - Custom purpose-built? Yeah, that's what backup programs are for. - Custom data layout? Check. (Rabin/BuzHash content-defined chunking, SHA256 dedupe.) - Adding additional versions? Yes. ("Incremental backups"— See above.) - Virtual filesystem access? `restic mount`/`borg mount`.

DrFrugal 7 months ago | [–]

thanks for mentioning those 2 projects, will check them out over the holidays and do some experimenting ^^

mappu 7 months ago | [–]

The same storage system is used by some non-backup software too, Perkeep and Seafile

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact