天空вℓσи∂ [Unemployed edition] @skyblond@qoto.org

Despite TeraCopy has a better GUI, it actually faster than ltfscopy.

The ltfscopy simply calls other program like copy (on Windows, or cp on Linux), then call md5sum twice to get original file hash and target file hash, all in sequence. Which I think you can calculate the hash when you copying it, or just calculate the two md5 checksum at the same time.

With a 330GB file, my SSD can read up to 300MB/s, and LTO6 tape drive can read up to 160MB/s. I can save ~18 minutes just by doing it smarter.

PS: TeraCopy do support SHA3-256 but it can only handle ~80MB/s, which is a huge shame. I have to use Blake3 to speed things up.

ok, I just found out that I don't need ltfscopy to ensure files are copied correctly.

I can use TeraCopy, it will make sure files are correct. Then I'll use my code to calculate hash and store in a database.

Who need filesystem attributes? LOL

I noticed my tape drive with ltfscopy, can wrtie 160MB/s consistently, but only read 60MB/s when verifying (read 300MB/s from my local SSD, using md5sum).

Later I'll read it from my own code and see how fast it can go.

I developed a kind-of-secure workflow when archiving things to tape. Where I select files and copy them to a second-hand tape to see how compression working. When I finally done, I keep a local storage and write then to a new tape. By using ltfscopy with `-v` option, I can make sure the files are copying correctly. Then I run my own tools on the tape to get SHA3-256 (which implemented by BouncyCastle, should be able to handle 160MB/s). Then I can verify the first copy on that second hand tape using my own tool. If everything goes right, I can make the third copy without `-v` option since I know the correct SHA3 generated by my code.

Now I'll have three copies of the same data, one with second-hand HPE MP tape, one with new HPE MP tape, and one new IBM BaFe tape.

Just notice how picky lto tapes are. Winter is fine, and the room temperature ranges from 20 C to 30 C, with 20% RH.

Summer is difficult. 40C with 90% RH.

I can't wait to see my tapes become a solid chunk of films and become unreadable

IBM gives two label stickers per tape. How generous!

Now my HPE tapes will be labeled by IBM stickers 😋

While HPE didn't enclose any label stickers in the package, the logo itself looks like a good place to write notes 😂

Another post-install issue is where to get tapes. There are second-hand LTO6 tapes costing around 10 USD, which basically is a blindbox. You never know the condition of the tape until you get it.

The brand new LTO6 tape is around 30 USD each. Guaranteed in excellent condition, but expensive. Considering I'll store the same file on 3 tapes to ensure safety, that's not cheaper than a HDD. (But with HDD, now I only have a unraid to check the files are good, I have no back up )

Now I'm writing a simple cli tools to help me track what files are on which tape.

I need some recommendations about LTFS based file management system. I noticed YoYotta but it's a Mac-only thing.

A lot of people on reddit suggest "just use tar", but I don't see how it can help me find out what tape do I need to load in order to get some file.

Finally got tape drive working!

Returned the tape drive back to seller.

Somehow the ltfs keep failing on windows. I think it might be hba card's issue. The official ltt tools passed the tape drive and cartridge test, so shouldn't be hardware issue.