Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vine: dask executor worker transfers segfault fix #3831

Merged

Conversation

btovar
Copy link
Member

@btovar btovar commented May 10, 2024

Makes the behavior of python tasks and function calls the same when dealing with input and output files. The caller should be in charge of undeclaring outputs. Function calls used to undeclare output when calling t.output, but this side effect made it hard to the caller to decide what to do with files.

This change also makes it easier to achieve #3828 and #3829.

Post-change actions

Put an 'x' in the boxes that describe post-change actions that you have done.
The more 'x' ticked, the faster your changes are accepted by maintainers.

  • make test Run local tests prior to pushing.
  • make format Format source code to comply with lint policies. Note that some lint errors can only be resolved manually (e.g., Python)
  • make lint Run lint on source code prior to pushing.
  • Manual Update Did you update the manual to reflect your changes, if appropriate? This action should be done after your changes are approved but not merged.
  • Type Labels Select github labels for the type of this change: bug, enhancement, etc.
  • Product Labels Select github labels for the product affected: TaskVine, Makeflow, etc.
  • PR RTM Mark your PR as ready to merge.

Additional comments

This section is dedicated to changes that are ambitious or complex and require substantial discussions. Feel free to start the ball rolling.

@btovar btovar merged commit 9305098 into cooperative-computing-lab:master May 10, 2024
7 checks passed
@btovar btovar deleted the worker_transfers_segfault_fix branch May 10, 2024 14:52
btovar added a commit that referenced this pull request Jun 14, 2024
* vine: tasks and funcalls behave the same wrt undeclaring files

The caller should be in charge of undeclaring outputs.

* vine: renamed lazy_transfers to worker_transfers

* add missing comma

* remove debug statement

* fix typo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant