Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker wrapper: always mount slot dir at WORKDIR #5886

Merged
merged 6 commits into from
Nov 7, 2024
Merged

Conversation

davidpanderson
Copy link
Contributor

This means that the tree rooted at WORKDIR is on the host filesystem,
and therefore survives system restarts;
otherwise it wouldn't.

This also simplifies file access from containers.
There's no need to copy input files from the slot dir to the container;
they're already in the container.
Similar with output files.
Remove these capabilities from the wrapper.

If a Docker app wants to access files in the project dir
(e.g. if they're huge files, shared with other jobs)
it can do so by mounting the project dir (using job.toml)
and then parsing the link files.

Merge the two test cases (copy and mount) into one
in both standalone and app_test.

Fixes #5882

This means that the tree rooted at WORKDIR is on the host filesystem,
and therefore survives system restarts;
otherwise it wouldn't.

This also simplifies file access from containers.
There's no need to copy input files from the slot dir to the container;
they're already in the container.
Similar with output files.
Remove these capabilities from the wrapper.

If a Docker app wants to access files in the project dir
(e.g. if they're huge files, shared with other jobs)
it can do so by mounting the project dir (using job.toml)
and then parsing the link files.

Merge the two test cases (copy and mount) into one
in both standalone and app_test.
Docker chokes on the Windows-style "c:\blah..." path
@AenBleidd AenBleidd added this to the Client/Manager 8.2.0 milestone Nov 7, 2024
@AenBleidd AenBleidd merged commit fa6d6c8 into master Nov 7, 2024
153 checks passed
@AenBleidd AenBleidd deleted the dpa_docker3 branch November 7, 2024 14:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Merged
Development

Successfully merging this pull request may close these issues.

Docker job persistence
2 participants