Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eval bug: #10980

Open
wang639 opened this issue Dec 26, 2024 · 0 comments
Open

Eval bug: #10980

wang639 opened this issue Dec 26, 2024 · 0 comments

Comments

@wang639
Copy link

wang639 commented Dec 26, 2024

Name and Version

出现的问题
Welcome to Qwen.cpp! Ask whatever you want. Type 'clear' to clear context. Type 'stop' to exit.

Prompt > hello
qwen > unknown token: 151935

ubuntu版本:20.04
使用的软件:qwen.cpp 1.3 和1.2都试过
使用的硬件:jetson orin nano 4gb jetpack:5.1.1

Operating systems

Linux

GGML backends

CUDA

Hardware

jetson orin nano 4gb jetpack:5.1.1

Models

Qwen-1_8B-Chat

Problem description & steps to reproduce

使用量化转译后的qwen1.8B 运行在orin nano中 使用qwen.cpp运行 无法识别文本 报位置错误
cuda等基础ai环境已经装好基础ai环境
微信图片_2024-12-26_164133_589

First Bad Commit

No response

Relevant log output

Welcome to Qwen.cpp! Ask whatever you want. Type 'clear' to clear context. Type 'stop' to exit.

Prompt > hello
qwen > unknown token: 151935
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant