Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]: Embedding Model Issue: Is jina-clip-v2 Supported in RAGflow? #4254

Open
midilandlu opened this issue Dec 26, 2024 · 4 comments
Open
Labels
question Further information is requested

Comments

@midilandlu
Copy link
Contributor

midilandlu commented Dec 26, 2024

Describe your problem

RAGflow version : v0.14.1-239-g097aab09 slim (Nightly-slim )

Issue Description
When I set the embedding model to jina-clip-v2 in Model Providers - Xinference, the following error message appears.

hint : 102
Fail to access embedding model(jina-clip-v2).index 0 is out of bounds for axis 0 with size 0

Screenshot 2024-12-26 at 11 01 29 PM

RAGflow server log

2024-12-26 23:24:27,568 INFO     21 172.18.0.6 - - [26/Dec/2024 23:24:27] "GET /v1/user/info HTTP/1.1" 200 -
2024-12-26 23:24:27,573 INFO     21 172.18.0.6 - - [26/Dec/2024 23:24:27] "GET /v1/user/tenant_info HTTP/1.1" 200 -
2024-12-26 23:24:27,573 INFO     21 172.18.0.6 - - [26/Dec/2024 23:24:27] "GET /v1/llm/my_llms HTTP/1.1" 200 -
2024-12-26 23:24:27,598 INFO     21 172.18.0.6 - - [26/Dec/2024 23:24:27] "GET /v1/llm/factories HTTP/1.1" 200 -
2024-12-26 23:24:37,581 INFO     22 task_consumer_0 reported heartbeat: {"name": "task_consumer_0", "now": "2024-12-26T23:24:37.578+08:00", "boot_at": "2024-12-26T23:18:37.203+08:00", "pending": 0, "lag": 0, "done": 0, "failed": 0, "current": null}
2024-12-26 23:24:38,464 INFO     21 HTTP Request: POST http://host.docker.internal:9997/v1/embeddings "HTTP/1.1 200 OK"

I would like to ask whether this embedding model is currently unsupported in the current version of RAGflow.

Thank you!

@midilandlu midilandlu added the question Further information is requested label Dec 26, 2024
@KevinHuSh
Copy link
Collaborator

It's supported.
Could you request Xinference by curl and show the response here?

@midilandlu
Copy link
Contributor Author

I attempted to request Xinference using curl, but encountered the following result. I am not sure if there is an error in my input.

My Input:

curl http://0.0.0.0:9997/v1/embeddings -H "Content-Type: application/json" -d '{ "input": "测试ebmeddings", "model": "jina-clip-v2" }'

Output Message: {"detail":"[address=127.0.0.1:49547, pid=80810] 'list' object has no attribute 'tolist'"}%

@devMls
Copy link
Contributor

devMls commented Dec 30, 2024

@midilandlu a question... what hardware/cloud you use for run jinaclip with xinference?

@midilandlu
Copy link
Contributor Author

@devMls we use L40 server for run jinaclip with Xinference

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants