multi vector models?

[raghavlite]

Is there a example to use multi vector models like Colbert?

[KennethEnevoldsen]

(Moving this to discussion as it is a usage question.)

I believe this might be what you are looking for:
https://github.com/embeddings-benchmark/mteb?tab=readme-ov-file#using-a-cross-encoder-for-reranking

[sam-hey]

I've raised this issue: #1560. At the moment, MTEB only supports cosine similarity and dot product, which means it doesn't accommodate Multi-Vector Models like ColBERT. I hope this limitation can be addressed soon.

Best regards
Sam

[Samoed]

Yes, main doesn't support

[CZH-THU]

Will it support in the future?

[sam-hey]

The PR is approved and is expected to be merged soon. Please note that the current implementation does not utilize any indexing, making it resource-intensive for large datasets. This will be updated once Pylate introduces the PLAID Index.

[CZH-THU]

Nice! Thanks.

[Samoed]

I've merged this PR to main