Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

delta-sharing 1.3.0 is not possible to install in databricks #620

Open
sergioumaya opened this issue Dec 19, 2024 · 3 comments
Open

delta-sharing 1.3.0 is not possible to install in databricks #620

sergioumaya opened this issue Dec 19, 2024 · 3 comments

Comments

@sergioumaya
Copy link

I'm not sure this is the right forum but we are getting the following error when trying to install delta sharing

zipfile.BadZipFile: Bad CRC-32 for file 'delta_kernel_rust_sharing_wrapper/delta_kernel_rust_sharing_wrapper.abi3.so'

Seems the issue is the latest release for the delta-kernel-rust-sharing-wrapper package.

Installing delta-kernel-rust-sharing-wrapper==0.1.0 and then installing delta-sharing==1.2.0 worked.

However, installing only delta-sharing previous versions (1.2.0, 1.1.1) raises the same error because it tries to install the delta-kernel-rust-sharing-wrapper latest version.

Test Envs:

  • Databricks workspaces with different runtimes: 13.3, 14.3 and 15.2
  • Python versions: 3.10 and 3.11
@sergioumaya sergioumaya changed the title delta-sharing 1.3.0 is not possible to install delta-sharing 1.3.0 is not possible to install in databricks Dec 19, 2024
@dude920228
Copy link

My team also has this issue and now we cannot do deployments because of this.

@PatrickJin-db
Copy link
Collaborator

PatrickJin-db commented Dec 21, 2024

Should be fixed in release 0.2.1 of the rust wrapper. We have also re-released the delta-sharing package as 1.3.1.

@aimtsou
Copy link

aimtsou commented Dec 26, 2024

I confirm that delta-sharing from pypi is installed in databricks 14.3 with %pip install delta-sharing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants