Follow

Funny that while I have tested quantized version of qwen2.5-coder:14b and the 7b, the former is breaking, the latter does not know what to do with my simple instruction.

Then i noticed a little chat box on the lower right and for a while I forgot that VS Code comes with Github Copilot and I gave my instruction which was executed in split second perfectly.

Frontier models are still better than local open source ones or maybe I have not explored around yet but simply because hardware is the constraint for me at the moment.

Need to invest on a hardware infrastructure for AI for my engineering needs.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.