Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix DataSetImplements such that we can use functools.reduce again #221

Merged
merged 1 commit into from
Nov 8, 2023

Conversation

nanne-aben
Copy link
Collaborator

@nanne-aben nanne-aben commented Nov 8, 2023

In the current master, the following code results in linting errors:

functools.reduce(
    DataSet.unionByName,
    [create_empty_dataset(spark, A), create_empty_dataset(spark, A)],
)

This is at odds with earlier versions of typedspark. This PR fixes the behaviour so that it's consistent with earlier versions.

@nanne-aben nanne-aben merged commit ed8cd15 into main Nov 8, 2023
4 checks passed
@nanne-aben nanne-aben deleted the hotfix-dataset-implements branch November 8, 2023 12:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant