Suggestion

[scavru]

Hi, your project is interesting, I found a similar project where many features are implemented. Maybe it will help you. https://github.com/gkvoelkl/python-llm-ratisbona-adventure.
There is also a possibility to connect to open api endpoint and I was able to connect koboldccp, in your project connection to koboldccp didn't work. Ollama is too inconvenient and limits in models, open api is more universal and allows to use practically any LLM loaders. In general, look at that repository, maybe it will help you in the development of the project.

[scavru]

We waiting...