OMG can't believe it's working!!!
It's doing the inference on JVM (although still call the native C code in llama.cpp)
https://github.com/hurui200320/llama-cpp-kt/blob/master/src/test/kotlin/info/skyblond/libllama/example/Simple.kt
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.
https://github.com/hurui200320/llama-cpp-kt/blob/master/src/test/kotlin/info/skyblond/libllama/example/Simple.kt