Kirill A. Korinsky [kirill@korins.ky] wrote:
> 
> Here a version where I:
> 1. added runtime dependency on textproc/ripgrep
> 2. patched required current_exe() usage
> 3. added README with sample how it can be used against llama.cpp server
> 

I like this. I had done a similar README. In model_providers you should add:

headers = {}
query_params = {}

They might not break anything today but they are of no use to llama.cpp and
the future is less certain. They are designed for openai's interface.