Lanchain.js integration

[ansarizafar]

Is it some how possible to use rwkv.cpp with langchain.js https://js.langchain.com/docs/

[saharNooby]

If RWKV server from #17 is merged, it should be possible

CC @abetlen

[ansarizafar]

I don't want to use python or python based server. I want to use rwkv.cpp with langchain javascript version.

[abetlen]

@ansarizafar for server-side usage that would require runtime specific bindings (node-ffi / Deno FFI). One challenge is that you need to build the shared library on the processor you're targetting to get the best performance. For the python package I'm using scikit-build which allows you to build a nativ C/C++ project at install time.

[ansarizafar]

@abetlen I want to use rwkv model with langchain.js and bunjs https://bun.sh/. We can call native C/C++ libraries with Bun FFI module https://bun.sh/docs/api/ffi