Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Local-GPU LLM model (e.g. from huggingface) support #21

Open
2 tasks
michaelthwan opened this issue Feb 25, 2023 · 4 comments
Open
2 tasks

Local-GPU LLM model (e.g. from huggingface) support #21

michaelthwan opened this issue Feb 25, 2023 · 4 comments
Assignees
@karabC

Comments

@michaelthwan
Copy link
Owner

We support some API call (OpenAI / GooseAI) but it would be nice if we can select a model small but good enough to do the summarization work in local GPU.

  • Study models
  • Code the local GPU call LLM module
@michaelthwan
Copy link
Owner Author

Examples

@eren23
Copy link

eren23 commented Mar 5, 2023

@karabC if you are going to make like a document or something of your model study may I kindly take a look at it, there are many models and it's super easy to get lost so I just want it for learning stuff, if I missed anything when checking those models before etc.

@michaelthwan
Copy link
Owner Author

@eren23 Great idea !

@spergware
Copy link

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@karabC karabC

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@michaelthwan @karabC @eren23 @spergware