New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reading "partitioned data" #128

Open

isaacsanders opened this issue Mar 11, 2022 · 1 comment

isaacsanders commented Mar 11, 2022

Hey all,

I'm looking into using this project, and I don't know that there is an API for reading "partitioned data" as defined in the Apache Arrow documentation (source: https://arrow.apache.org/docs/python/dataset.html#reading-partitioned-data).

Both the python and nodejs libraries appear to implement this pattern.

Member

philss commented Mar 16, 2022

Interesting. I don't think we have this feature in Explorer today, but could be a nice one to have in the future :)

I notice that Polars doesn't have it either, so maybe it's a good idea to implement there first. They have two issues for that: pola-rs/polars#2257 and pola-rs/polars#426

josevalim mentioned this issue

Add collect_rows/collect_columns operations #271

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment