You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use docker run -it --rm --gpus 'device=0' -p 8016:80 -v XXX ...inference:1.6 --model-id .../gte-mutilingual-reranker-base .
Could not start Candle backend :could not start backend:cannot find tensor embedding.work_embdding.weight
Error: Could not create backend
cased by start backend:Could not start a suitable backend
Information
Docker
The CLI directly
Tasks
An officially supported command
My own modifications
Reproduction
"It also cannot run on version 1.5."
Expected behavior
Use docker run -it --rm --gpus 'device=0' -p 8016:80 -v XXX ...inference:1.6 --model-id .../gte-mutilingual-reranker-base .
Could not start Candle backend :could not start backend:cannot find tensor embedding.work_embdding.weight
Error: Could not create backend
cased by start backend:Could not start a suitable backend
The text was updated successfully, but these errors were encountered:
System Info
Use docker run -it --rm --gpus 'device=0' -p 8016:80 -v XXX ...inference:1.6 --model-id .../gte-mutilingual-reranker-base .
Could not start Candle backend :could not start backend:cannot find tensor embedding.work_embdding.weight
Error: Could not create backend
cased by start backend:Could not start a suitable backend
Information
Tasks
Reproduction
"It also cannot run on version 1.5."
Expected behavior
Use docker run -it --rm --gpus 'device=0' -p 8016:80 -v XXX ...inference:1.6 --model-id .../gte-mutilingual-reranker-base .
Could not start Candle backend :could not start backend:cannot find tensor embedding.work_embdding.weight
Error: Could not create backend
cased by start backend:Could not start a suitable backend
The text was updated successfully, but these errors were encountered: