Is it still possible to generate GGML quants? #137
Unanswered
walking-octopus
asked this question in
Q&A
Replies: 1 comment
-
|
At the moment, it's not supported. I'll add it later. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Laptops have quite little disk space. Since all they can run are quants anyway, it makes sense to just quantize once and reuse instead of even keeping raw weights.
Beta Was this translation helpful? Give feedback.
All reactions