Follow
llamacpp on JVM, powered by JNA.
For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?
Maybe I should move this project out of playground folder and publish to github.
Also, some fun fact: JNA do not support C++, while most people just mix C and C++. Thus the JNA can't handle `bool` in Java. The boolean from Java is 4 bytes, while the bool in C++ is 1 byte. Thus you have to use byte to replace the bool.
I use ksp for code generation, so you don't have to write those ugly hacks for kotlin.
You write something like p1 and got something like p2 and p3 automatically.