Follow

llamacpp on JVM, powered by JNA.

For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?

Maybe I should move this project out of playground folder and publish to github.

I use ksp for code generation, so you don't have to write those ugly hacks for kotlin.

You write something like p1 and got something like p2 and p3 automatically.

Also, some fun fact: JNA do not support C++, while most people just mix C and C++. Thus the JNA can't handle `bool` in Java. The boolean from Java is 4 bytes, while the bool in C++ is 1 byte. Thus you have to use byte to replace the bool.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.