I soft-launched this a few weeks back, but here is my most polished (i.e. not very) @rustlang project to date: metadata-backup, a tool for backing up your file system metadata.

Contributions welcome!

gitlab.com/pganssle/metadata-b

I did some basic profiling and I think the multi-threading behavior is actually not buying me much, because a lot of the time is spent doing the zip encoding.

Not sure if there is a simple way to parallelize that or if it's even worth doing.

Follow

@pganssle parallelization is tricky business. In the end what sort of run times are you even facing here?

@freemo Depends on what you are backing up. A few seconds in most cases, but if you hit something with hundreds of thousands of little files and directories it can be minutes or more (in my case some deduplicating backups).

In my use case backing those up isn't that useful anyway, so a way to exclude them is probably a more fruitful way to speed up my backups.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.