Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

arm64 raspberry pi docker image #4205

Open
maxvaneck opened this issue Nov 20, 2024 · 1 comment
Open

arm64 raspberry pi docker image #4205

maxvaneck opened this issue Nov 20, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@maxvaneck
Copy link

Is your feature request related to a problem? Please describe.
it would be nice for people to be able to run localai on their surplus of raspberry pi's so my proposal is for a arm64 docker image especially for people tinkering with a turing pi cluster even though it would be slow as hell maybe even run it using vulkan since the pi gpu driver is now vulkan conformant . maybe even a jetson nano specific build

Describe the solution you'd like
an arm64 docker build with optional vulkan support in time maybe if feasible

Describe alternatives you've considered
gpus and cpu's are expensive and guzzle power

Additional context
x gpu's and cpu's are expensive and a raspberry pi is almost universally part of someones tinker environment

@maxvaneck maxvaneck added the enhancement New feature or request label Nov 20, 2024
@Finnsflyer
Copy link

pi's do not have the computing power to run localai, mine can barely run a web browser in 720p.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants