Follow

One thing I need to change is the way how I interact with AI Models or LLMs.

Turns out my way is expensive and after learning from the AI Engineering course that the context of a particular one time chat with a frontier model covers only what is passed during that context and becomes the memory of the AI Model and also relates to the tokens to it and the total billing, and in that way also a quantitative basis for consuming free tiers as well, I need to learn how efficient prompt engineering and later on efficient RAG.

In short, I must learn to convey a problem to an AI Model in the shortest possible equivalent tokens, and also I must learn to constraint the AI Model to only output what I need instead of giving back a ton of explanations that I don't need because the formula for billing an AI Model use is:

(input token * input token price) +(output token * output token price).

No wonder I always reach the max limit on my free tiers on different models of ChatGPT and I ended up subscribing with Codex because I also reach the max free tier limit for Codex 🤣

With Raptor.mini for C development, I should be much careful because it is free tier also and has limits.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.