It's much better than 7B model!!!
Can't wait to see the 70B models. The llama 2 70B model uses a different design than the llama 1, so llama.cpp currently won't work on 70b model.
But that's amazing! A LLM running on my laptop!
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.