We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CUDA Version: 12.4 docker 部署
dify version: 0.14.2 xinference version v1.1.1
flux 如下
dify中工具配置如下 只有一个请求,生成20 step 可以正常生成,20 step多个请求或单请求28 step会生成失败,看xinference没有错误日志。 xinference日志:
dify 返回信息
step 28步应该也可以生成,flux模型支持连续批处理,会不会和这个有关系。
The text was updated successfully, but these errors were encountered:
No branches or pull requests
System Info / 系統信息
CUDA Version: 12.4
docker 部署
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
dify version: 0.14.2
xinference version v1.1.1
The command used to start Xinference / 用以启动 xinference 的命令
flux 如下
Reproduction / 复现过程
dify中工具配置如下
只有一个请求,生成20 step 可以正常生成,20 step多个请求或单请求28 step会生成失败,看xinference没有错误日志。
xinference日志:
dify 返回信息
Expected behavior / 期待表现
step 28步应该也可以生成,flux模型支持连续批处理,会不会和这个有关系。
The text was updated successfully, but these errors were encountered: