This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 211
Issues: intel/intel-extension-for-transformers
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
'RuntimeError: "normal_kernel_cpu" not implemented for 'Char'
#1700
opened Oct 1, 2024 by
bhaskarachalla
After fine-tuning qwen2-1.5B-instruction and quantifying its AWQ, an error occurred while using Intel Extension for Transformers and CPU for inference. But when I used the same method to fine tune and quantify qwen1.5-4B chat before, I could use Intel Extension for Transformers to accelerate CPU inference. 对qwen2-1.5B-instruct微调并且awq量化后,使用intel-extension-for-transformers和CPU进行推理时出错。但我之前使用同样的方式微调和量化的qwen1.5-4B-chat时是可以使用intel-extension-for-transformers加速CPU推理的。
#1697
opened Sep 11, 2024 by
Autism-al
Error in import: ModuleNotFoundError: No module named 'neural_compressor.conf'
#1695
opened Aug 27, 2024 by
Nicogs43
AutoModelForCausalLM model.generate Wrong response by docker run the same chatglm3-int4 model bin file
#1680
opened Jul 28, 2024 by
ahlwjnj
question about configuration
documentation
Improvements or additions to documentation
#1643
opened Jun 28, 2024 by
menglin0320
[Neural_chat] Chat completion is very slow with neuralchat_server
#1616
opened Jun 17, 2024 by
noobHappylife
neuralchat /v1/askdoc/create 404 not found. Failed to call this api on ubuntu system.
aitce
NeuralChat
#1533
opened May 8, 2024 by
RongLei-intel
[neural-chat]: deployment backend server failed to start
aitce
#1525
opened May 2, 2024 by
raj-ritu17
Cannot run llama3 8b instruct:
AssertionError: Fail to convert pytorch model
#1522
opened Apr 30, 2024 by
N3RDIUM
ITREX need to do modification for llama3 new prompt format
#1507
opened Apr 23, 2024 by
redhairerINTEL
Python3.11: Could not build wheels for cchardet, which is required to install pyproject.toml-based projects
#1469
opened Apr 10, 2024 by
bbelky
SageMaker does not support Transformers 4.34.1 which is required by ITREX
#1381
opened Mar 14, 2024 by
eduand-alvarez
Previous Next
ProTip!
What’s not been updated in a month: updated:<2024-11-29.