We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
It can be slow on CPU mode but recently Intel introduced its NPU
I suggest xinference support running on intel NPU
or it will have to run on CPU mode
The text was updated successfully, but these errors were encountered:
I don't know if OpenVINO can work on intel NPU, we are introducing OpenVINO in #1677 .
Sorry, something went wrong.
Yeah Intel officially uses openVINO in the demo. It may not work very well with too large models though.
This issue is stale because it has been open for 7 days with no activity.
No branches or pull requests
Is your feature request related to a problem? Please describe
It can be slow on CPU mode but recently Intel introduced its NPU
Describe the solution you'd like
I suggest xinference support running on intel NPU
Describe alternatives you've considered
or it will have to run on CPU mode
The text was updated successfully, but these errors were encountered: