Code

Ingestor command refactoring#92

Code

Closed

consolethinks wants to merge 40 commits intomainpaulscherrerinstitute/scicat-cli:mainfrom feature/library_refactorpaulscherrerinstitute/scicat-cli:feature/library_refactorCopy head branch name to clipboard

+1,316-1,104

Commits

Commits on Jul 19, 2024

• authentication refactor

  consolethinks

  committed
  8c551b8

Commits on Jul 22, 2024

• move 'authenticate' function to CLI

  consolethinks

  committed
  7dc7ebb

Commits on Jul 23, 2024

• change ioutil to io (ioutil is deprecated)

  consolethinks

  committed
  85521de

• improve checkMetadata

  consolethinks

  committed
  38160d9

• throw error in checkUserAndOwnerGroup if 'ownerGroup' is missing in metadata

  consolethinks

  committed
  6a63568

• testForExistingSourceFolder refactor

  consolethinks

  committed
  6c2e73d

Commits on Jul 24, 2024

• improve add attachment

  

  Consolethinks

  committed
  556bcd4

• improve create job

  

  Consolethinks

  committed
  f719545

• update dataset archiver to handle CreateJob error

  

  Consolethinks

  committed
  49590b0

Commits on Jul 29, 2024

• improve assmebleFilelisting, datasetIngestor command

  consolethinks

  committed
  ee0c243

Commits on Jul 30, 2024

• refactor datasetIngestor command further

  consolethinks

  committed
  f49b17a

• fix a potential bug in add attachment

  consolethinks

  committed
  38b1646

• avoid logs, return errors in checkDataCentrallyAvailable

  consolethinks

  committed
  62e488b

• checkMetadata: avoid logs, return errors

  consolethinks

  committed
  8aef7a7

• remove useless lines

  consolethinks

  committed
  80e5006

• sendFilesReadyCommand: return errors, avoid logging

  consolethinks

  committed
  cbd3960

• sendIngestCommand: better error handling, avoid logging

  consolethinks

  committed
  5d7ff42

• updateMetaData: change pointer parameters into pass-by value, avoid logging, better error handling

  consolethinks

  committed
  2d7e97b

• createJob: rename function to createArchivalJob

  consolethinks

  committed
  436d3f8

• checkMetadata_test: fix a bug related to undeterministic order of keys

  consolethinks

  committed
  50463a4

Commits on Aug 5, 2024

• rename files in datasetIngestor/

  consolethinks

  committed
  c0037f3

• checkMetadata_test: add extra check for invalid keys

  consolethinks

  committed
  3eb74f6

• refactor create/delete dataset entry

  consolethinks

  committed
  4658846

Commits on Aug 6, 2024

• getLocalFileList:

  Show description for e9d8673
  consolethinks

  committed
  e9d8673

Commits on Aug 7, 2024

• checkDataCentrallyAvailable: ssh now outputs into a param available for caller

  consolethinks

  committed
  03e3407

• getLocalFileList: filename check is now a callback

  consolethinks

  committed
  90606b8

• testForExistingSourceFolder: remove logging

  consolethinks

  committed
  1b9550b

• ingestDataset: fix error message

  consolethinks

  committed
  4c6b2fc

• datasetIngestor: adjust to library changes, add filename checker callback function

  consolethinks

  committed
  0771c3c

Commits on Aug 8, 2024

• checkmetadata: make internal functions available, add descriptions

  consolethinks

  committed
  8f01411

• syncDataToFileserver: redirect progress report to optional variable

  consolethinks

  committed
  fcd68c7

• adjust dataset ingestor cli to changes

  consolethinks

  committed
  40f34a4

• getLocalFileList: remove remainder of logging

  consolethinks

  committed
  f2484b6

• checkDataCentrallyAvailable: specify os in error message

  consolethinks

  committed
  3cce340

• syncDatgaToFileserver: remove remaining logging

  consolethinks

  committed
  c9d894d

• dataset ingestor cmd: announce local filelist gathering operation, adjust a comment

  consolethinks

  committed
  89f8500

Commits on Aug 9, 2024

• testForExistingSourceFolder: fix a bug that discarded the gathered list

  consolethinks

  committed
  5ce6908

• getLocalFileList: fix symlink path handling

  consolethinks

  committed
  6632a6f

• datasetIngestor: fix the check for "allowexistingsource is set"

  consolethinks

  committed
  9bfcb6e

Commits on Aug 12, 2024

• a couple of corrections and comment updates

  consolethinks

  committed
  de871c6