Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEEPSEEK只能输出4096token长度 #811

Open
daxiass opened this issue Nov 11, 2024 · 2 comments
Open

DEEPSEEK只能输出4096token长度 #811

daxiass opened this issue Nov 11, 2024 · 2 comments

Comments

@daxiass
Copy link

daxiass commented Nov 11, 2024

Describe the bug
问题描述
在API设置里把token输出长度拉满了也只能4096token

To Reproduce
如何复现
使用DEEPSEEK API

Expected behavior
期望行为
修复这个BUG
Screenshots
截图说明
If applicable, add screenshots to help explain your problem.

Please complete the following information):
请补全以下内容

  • win10
  • chrome129

Additional context
其他
Add any other context about the problem here.

@Latsummer
Copy link

这个应该是deepseek的接口问题,deepseek那边文档中写的api地址不支持大于4096Token的请求

看了一下错误是

{
  "error": {
    "message": "8K max_tokens is only available when using beta api (set base_url=\"https://api.deepseek.com/beta\")",
    "type": "invalid_request_error",
    "param": null,
    "code": "invalid_request_error"
  }
}

所以你可以试一下把链接设置为beta版的api https://api.deepseek.com/beta/chat/completions 再看看有没有报错, 不过这个api支持范围是[1, 8192]

@Latsummer
Copy link

这个应该是deepseek的接口问题,deepseek那边文档中写的api地址不支持大于4096Token的请求

看了一下错误是

{
  "error": {
    "message": "8K max_tokens is only available when using beta api (set base_url=\"https://api.deepseek.com/beta\")",
    "type": "invalid_request_error",
    "param": null,
    "code": "invalid_request_error"
  }
}

所以你可以试一下把链接设置为beta版的api https://api.deepseek.com/beta/chat/completions 再看看有没有报错, 不过这个api支持范围是[1, 8192]

OK了现在非beta也支持8k输出了
参照 https://api-docs.deepseek.com/zh-cn/quick_start/pricing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants