Use case: Parallel pipeline execution on partial data

[denisri]

Author: Nicolas S.

Summary: Run parallel processes on data that are only partially loadable in RAM (due to their size)

Description:

Each parallel process of a pipeline will access partially a sub-part of an image. The processed sub-part will be reintegrated to a whole image. The process should deal with border issues.

Participants: NA => single user

Datasets: Up to ~1000 images of ~200 GB each.

Data flow: local image -> HPC platform -> local result

Security: NA

Workgroup(s): pipeline