llamacpp on JVM, powered by JNA.

For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?

Maybe I should move this project out of playground folder and publish to github.

Follow

Also, some fun fact: JNA do not support C++, while most people just mix C and C++. Thus the JNA can't handle `bool` in Java. The boolean from Java is 4 bytes, while the bool in C++ is 1 byte. Thus you have to use byte to replace the bool.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.