The slides for the #radare2 #ai presentation made by @pancake are now public! Check them out while they are still hot! https://github.com/radareorg/radare2-extras/blob/master/r2ai/local/r2ai.pdf
@radareorg @pancake I tried using llama-2-7b-chat-codeCherryPop.Q5_K_M.gguf instead of llama-2-7b-chat-codeCherryPop.ggmlv3.q4_K_M.gguf, it's roughly 700mb bigger, gives similar results but supposedly more accurate ("large, very low quality loss - recommended"). Got it from here:
https://huggingface.co/TheBloke/llama2-7b-chat-codeCherryPop-qLoRA-GGUF
@modrobert ideally models from hugging face should be automatically downloadable from r2ai like it's done by open-interpreter, but i somewhat broke the code while messing with the code. now that i have a better idea of what to do and how i'll bring that back and shrink the current spaguetti code
@modrobert seems like the link got broken because the bot is not able to join the telegram channel for a reason :? but then i found that libera.chat banned the matrix bridge too https://matrix.org/blog/2023/08/libera-bridge-disabled/ so i guess i'll need to join the irc again and stay around.. or maybe i can bridge the irc with the fediverse
@pancake OK, thanks for checking.
@modrobert fixed the issue with the telegram bot :) so the bridge between irc and telegram is working again, only for the main channel (not the side one). still thinking if i should write the mastodon bridge :D as i prefer open platforms uber ales
@pancake Thanks! Yes, the mastodon bridge sounds interesting.
@modrobert cool! i have 5 different models (2 of them are uncensored) and i'm experimenting into converting conversational templates in order to make them talk to each other and expand the logic of one question with two or more, but learning how playing with the request tokens results in some interesting output.