Follow

Alright, I should have invested on a dedicated NVIDIA GPU's back in 2022 with a lower end CPU instead of getting an AMD APU.

Although I am still happy with my AMD Ryzen 7 5700G, there is a heavy constraint on what AI model's I can load on my local machine.

Anyways, I think I could buy a brand new NVIDIA GPU soon if not the dedicated AI accelerator chips so I can run more powerful AI models locally.

On the other hand, I got two machines sitting by my side doing nothing. These are old machines. One old laptop with an AMD A8 CPU and an old Oppo smartphone with a bulging battery.

I have prepared a project pipeline for these 2. The first project is to load AirLLM for both and see how a local AI model will perform using AirLLM architecture. The next project is to use llama.ccp on both.

Whatever works, that will make both of these old machines a separate AI nodes in my home network.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.