Long way to go. This is a baby hobby project on LLM or basically an experimental AI model without using the transformer architecture which has an aspect of quadtratic growth and what I'm building has linear growth provided memory is bounded.

If and only if this works for real with the training data and can perform at the level of the frontier models as we grow the parameters / weights, this might become one interesting LLM down the road 😂