Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ctransformers library #933

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

marella
Copy link

@marella marella commented Aug 31, 2023

All the GGML/GGUF models from https://huggingface.co/TheBloke can be used with ctransformers.

@osanseviero
Copy link
Contributor

Hi there! At the moment, we have a strict 1 repo, 1 library structure on the Hugging Face Hub. For this to work, all of the repos you mention would have to have the ctransformers tag, otherwise they would not show.

We see GGUF/GGML as file formats, the same as we see safetensors, onnx, etc. Because of this, we consider them framework-agnostic and don't enforce a library tag upon repos that have files with this format

@julien-c
Copy link
Member

yes, "library" in the Hub is really == modeling architecture library.

"File formats" however can coexist in the same repo, so maybe it would make sense to add some file formats for this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants