Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TTS inference using bark.cpp doesn't work properly on Android phone #178

Open
zhouwg opened this issue May 19, 2024 · 2 comments
Open

TTS inference using bark.cpp doesn't work properly on Android phone #178

zhouwg opened this issue May 19, 2024 · 2 comments

Comments

@zhouwg
Copy link

zhouwg commented May 19, 2024

The Project bark.cpp is excellent and thanks for your amazing bark.cpp. I want to utilize the bark.cpp as TTS engine in my learning project.

TTS inference using bark.cpp doesn't work properly on Android phone currently
https://github.com/zhouwg/kantv/blob/master/core/ggml/barkcpp/bark.cpp#L1347

https://github.com/zhouwg/kantv/blob/master/core/ggml/barkcpp/bark.cpp#L1558

https://github.com/zhouwg/kantv/blob/master/core/ggml/barkcpp/bark.cpp#L1751

I found that GGML's internal / GGML API changes quickly/frequently:

https://github.com/zhouwg/kantv/blob/master/core/ggml/llamacpp/ggml.c#L4696

https://github.com/zhouwg/kantv/blob/master/core/ggml/llamacpp/ggml.c#L5848

Could you help to fix this issue(merge upstream GGML source code to your encodec.cpp because you are the original author of bark.cpp and know everything/details in internal of bark.cpp)?

thanks for your time and thanks so much.

@PABannier
Copy link
Owner

Thanks @zhouwg for the issue!
I'm in the process of pulling the latest version of ggml and encodec.cpp into bark.cpp, but it is a tedious and painfully long. I'll ping you when it is done.

@zhouwg
Copy link
Author

zhouwg commented Jun 7, 2024

Thanks @zhouwg for the issue! I'm in the process of pulling the latest version of ggml and encodec.cpp into bark.cpp, but it is a tedious and painfully long. I'll ping you when it is done.

thanks for your feedback so much.

I had been tried(bark.cpp using the latest ggml) in my personal learning project but the running result is not correct(I know very little about real/hardcore AI tech so I don't know how to fix it):
467524614

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants