llamacpp on JVM, powered by JNA.
For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?
Maybe I should move this project out of playground folder and publish to github.
Also, some fun fact: JNA do not support C++, while most people just mix C and C++. Thus the JNA can't handle `bool` in Java. The boolean from Java is 4 bytes, while the bool in C++ is 1 byte. Thus you have to use byte to replace the bool.
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.