Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please add Snowpark support #290

Closed
achrusciel opened this issue Apr 23, 2024 · 3 comments
Closed

Please add Snowpark support #290

achrusciel opened this issue Apr 23, 2024 · 3 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@achrusciel
Copy link

https://docs.snowflake.com/en/developer-guide/snowpark/python/index

Snowflake is a popular database management system (dbms). It is really fast and easy to handle. Snowpark is a dataframe api implementation which is close to spark, but not exactly the same. I ran a sample code with datacompy and the reports for "Column Summary" and "Schema Differences" work well out-of-the-box. The execution fails with the report "Row Summary". When looking at the query executed against Snowflake it is visible that the syntax is not compatible with Snowflake. Seems to be a different dialect/syntax required. I'v rewritten parts of the "faulty" query and I got results.

@fdosani fdosani added enhancement New feature or request help wanted Extra attention is needed labels Apr 23, 2024
@fdosani
Copy link
Member

fdosani commented Apr 23, 2024

@achrusciel thanks for the feature request. Happy to accept a PR if you have the time to contribute? I can also take a closer look at this in a bit here. Totally open to adding in the support if you and others would find this helpful.

@fdosani
Copy link
Member

fdosani commented Sep 13, 2024

FYI, we have a PR for snowpark support #333
Another option I was thinking about was looking into https://ibis-project.org/ (cc: @gforsyth 😄 )

@fdosani
Copy link
Member

fdosani commented Oct 29, 2024

#333 has been merged. Next release should have support.

@fdosani fdosani closed this as completed Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants