It is clearly impossible when it comes to ChatGPT but there are many simple models that can run locally with a small impact on resources like this one, that could be useful for semantic search:
https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
Other ideas are tasks like "find all the PDFs about Foo and copy them in a folder on the desktop". Things like this should be possible without big models like GPT4.
Something that KDE software could provide independently from the models are some confirmation dialogs that summarize a task.
In the example above it would be a dialog that says "Move N PDFs into <folder>?" and it lists files with a conventient UI.
These dialogs could be used by any program, not specifically by a ML model, but they makes sense with ML to be sure that the model is interpreting correctly the prompt.
@nicofee
Something that KDE software could provide independently from the models are some confirmation dialogs that summarize a task.
In the example above it would be a dialog that says "Move N PDFs into <folder>?" and it lists files with a conventient UI.
These dialogs could be used by any program, not specifically by a ML model, but they makes sense with ML to be sure that the model is interpreting correctly the prompt.