Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory monitoring. #4

Open
YooSunYoung opened this issue Nov 30, 2023 · 1 comment
Open

Memory monitoring. #4

YooSunYoung opened this issue Nov 30, 2023 · 1 comment

Comments

@YooSunYoung
Copy link
Member

NMX uses relatively large amount of raw data, so we might need to have an option to monitor/log memory consumption.
i.e. The original script from the owner was using tracemalloc to monitor memory.

It can probably be done in a similar way to the beamlime benchmarking...?

@SimonHeybrock
Copy link
Member

I don't think we should worry about such things now. NMX experiments will run a long time with not that many events so data volume should not be a problem any more than for other instruments.

We can always process chunks in wall-time if files get too large, i.e., avoid the problem instead of adding monitoring.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants