Alright, so now I am working on an alternative architecture for LLMs and is going to be written in C.

Not sure yet if this is going to be better in reality although in theory the theorem for the architecture is solid. It borrows and aggregates ideas from unrelated different projects.

If this goes well, we will be seeing new AI Models that are at the same level as the frontier models but has a small computing resource footprint hence can be run on consumer PCs.