Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cerebras model updates --> Llama-3.3-70B in Aidier 0.69.1? #2703

Open
hrstoyanov opened this issue Dec 25, 2024 · 1 comment
Open

Cerebras model updates --> Llama-3.3-70B in Aidier 0.69.1? #2703

hrstoyanov opened this issue Dec 25, 2024 · 1 comment

Comments

@hrstoyanov
Copy link

hrstoyanov commented Dec 25, 2024

Issue

Hello, can you please update the Aider 0.69.1+ metadata for Cerebras provider, to include model Llama-3.3-70B:

CEREBRAS_API_KEY=xxxx
CEREBRAS_API_BASE=https://api.cerebras.ai/v1
...
% aider --list-models cerebras/
Models which match "cerebras/":
- cerebras/llama3.1-70b
- cerebras/llama3.1-8b

% aider --model cerebras/llama-3.3-70B
Warning for cerebras/llama-3.3-70B: Unknown context window size and costs, using sane defaults.
Did you mean one of these?
- cerebras/llama3.1-70b
- cerebras/llama3.1-8b
You can skip this check with --no-show-model-warnings

https://aider.chat/docs/llms/warnings.html
Open documentation url for more info? (Y)es/(N)o/(D)on't ask again [Yes]: 

Version and model info

Provider: Cerebras API
Model : Llama3.3-70B (new)
Aider: 0.69.1

@hrstoyanov
Copy link
Author

At a minimum, need to know the token limit:

litellm.BadRequestError: CerebrasException - Error code: 400 - {'message': 'Please reduce the length of the messages or completion. Current length is 14056 while limit is 8192', 'type': 
'invalid_request_error', 'param': 'messages', 'code': 'context_length_exceeded'}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant