Comment by nhanb
3 years ago
Not GP but one disadvantage of updating one huge file is it's harder to do efficient incremental backups. Theoretically it can still be done if your backup software supports e.g. content-defined chunking (there was a recent HN thread about Google's rsync-with-fastcdc tool). If you choose to store your assets as separate files instead though, you can trivially have incremental backups using off-the-shelf software like plain old rsync [1].
[1]: https://www.cyberciti.biz/faq/linux-unix-apple-osx-bsd-rsync...
> there was a recent HN thread about Google's rsync-with-fastcdc tool
Was this the tool & thread you mean? https://news.ycombinator.com/item?id=34303497?
Yeah that's the one!
Although for SQLite in particular, you can do streaming incremental backups with Litestream: https://litestream.io/