Trying to investigate alternative implememtations of AI models apart from the transformer architecture or maybe a step away from the use of binary floating point representation of the embeddings vector for cheaper arithmetic operations in the computer.

That means I'd be looking at research papers soon on this area.

On the other hand, I am tempted to write an AI model using pure C language but it turns out that I need to train the model after and since there is literally zero training tools for models written in C but in Python, I'd be doing all these tools in C from scratch which is a no trivial matter

This also explains why Python is the language of choice for AI model development. It's not just because it abstracts a lot of complex coding stuffs if done in lower level programming language but because the development ecosystem of AI including the development of AI models are rich for Python and not for other languages and definitely not for C.