scientific data management

[ynikitenko]

This is not directly connected to Python, but

• data management is an important part of data analysis,
• Python is a general purpose high-level language that is helpful with managing data. The author is making a presentation about managing files with a wrapper around rsync written in Python.
• HSF has no dedicated group for "data management" (at least what I could find in its GitHub).

Discussion topics:

• data storage. File system vs database vs...
• data management (synchronisation, versions, ...). Working on one cluster vs (sustainably) copying part of the data to a local cluster / computer / etc.