new llm api

[baki2u]

Issue

how can I add support for custom llm api

I tried to mimic it by using openai compatible gemini api but it resulted in 404 error .. what am i doing wrong

aider --openai-api-base https://generativelanguage.googleapis.com/v1beta/models/gemini-1.5-pro-latest:generate --model openai/gemini-1.5-pro-latest sample1.c
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Warning for openai/gemini-1.5-pro-latest: Unknown context window size and costs, using sane defaults.
Did you mean one of these?

• gemini/gemini-1.5-pro-latest
  You can skip this check with --no-show-model-warnings

https://aider.chat/docs/llms/warnings.html
Open documentation url for more info? (Y)es/(N)o/(D)on't ask again [Yes]: n

Aider v0.69.1
Model: openai/gemini-1.5-pro-latest with whole edit format
Git repo: .git with 1 files
Repo-map: disabled
Added sample1.c to the chat.
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
sample1.c

fix

litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404

Version and model info

No response

[paul-gauthier]

Thanks for trying aider and filing this issue. This doc may be helpful:

https://aider.chat/docs/llms/gemini.html

[baki2u]

Thanks for trying aider and filing this issue. This doc may be helpful:

https://aider.chat/docs/llms/gemini.html

Thanks a lot for your time, Paul.

im actually trying to connect to llm on a custom server like baki.com/llm
using this approach resulted in 404 errors : https://aider.chat/docs/llms/openai-compat.html