Code

Feature/slurm remote support#250

Code

Draft

mhrtmnn wants to merge 30 commits intoesa-tu-darmstadt:developesa-tu-darmstadt/tapasco:developfrom mhrtmnn:feature/SlurmRemoteSupportmhrtmnn/tapasco:feature/SlurmRemoteSupportCopy head branch name to clipboard

+538-163

Commits

Commits on Nov 5, 2020

• Move slurm job template to separate SLURM directory

  mhrtmnn

  committed
  60b78d0

• Add parser for new JSON file type, that describes a remote SLURM node

  mhrtmnn

  committed
  68f49fb

• Change CLI such that different SLURM node templates can be selected

  mhrtmnn

  committed
  f5ea82d

• Add additional fields to Slurm.Job case class

  Show description for 0ba49cb
  mhrtmnn

  committed
  0ba49cb

• Add option for remote execution to Slurm object

  mhrtmnn

  committed
  4b01364

• Add a wrapper that handles local/remote execution of shell commands

  mhrtmnn

  committed
  b35dc81

• Add Pre/Postamble that runs before/after SLURM Job

  Show description for 9683925
  mhrtmnn

  committed
  9683925

• Make writeJobScript() work with remote paths

  mhrtmnn

  committed
  3b390c8

• Adapt Slurm.apply() to remote execution

  mhrtmnn

  committed
  b029b77

• Add postamble that pulls generated files from node

  mhrtmnn

  committed
  5e43cfa

• Use explicit identity func instead of custom lambda

  mhrtmnn

  committed
  c54e988

• Postamble: add timing and utilization report

  mhrtmnn

  committed
  92415ba

• Fix local SLURM execution

  mhrtmnn

  committed
  3e2183f

• Add optional sbatch CLI options to slurm json

  mhrtmnn

  committed
  619893e

• Add support for user-defined pre/postamble

  Show description for 16b4464
  mhrtmnn

  committed
  16b4464

• Remove unnecessary func parameter

  mhrtmnn

  committed
  773c47b

• Fix: Copy SLURM job script to correct host

  mhrtmnn

  committed
  0d4c832

• Finalize SLURM job template for ESA cluster

  mhrtmnn

  committed
  c5911ef

Commits on Nov 16, 2020

• Use Paths.get() instead of Path.of()

  mhrtmnn

  committed
  6b01e25

• Use unique slurm script names

  mhrtmnn

  committed
  74436f4

• Fix hls postamble

  mhrtmnn

  committed
  48c5fde

Commits on Nov 17, 2020

• Only pull SLURM artefacts if job was successful

  mhrtmnn

  committed
  6c92d0c

• HLS task: check slurm return code

  mhrtmnn

  committed
  27d8af3

• Handle return value correctly in slurm job

  mhrtmnn

  committed
  9d496b3

• Fix vivado hang

  mhrtmnn

  committed
  3207acd

• Reduce verbosity, cleanup

  mhrtmnn

  committed
  1d81cd6

Commits on Nov 28, 2020

• Cancel SLURM job if tapasco is terminated

  mhrtmnn

  committed
  ff4a8e9

• Show duration for which SLURM job has been running

  mhrtmnn

  committed
  b7c0a20

Commits on Dec 29, 2020

• Refactor Slurm tasks into slurm jobs

  Show description for 259e6ee
  mhrtmnn

  committed
  259e6ee

• Adapt Slurm pre/post-amble to changes in 259e6ee

  Show description for f84e5cc
  mhrtmnn

  committed
  f84e5cc