Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Postponed the assessment of GPU memory for testing (#601)
Since the GPUtil library does not allow us to measure the GPU memory usage for a specific process, we need to take a more cautious approach to gauge GPU usage. There's a likelihood that the GPU memory usage may not stabilize during the initial iterations, as illustrated below: ``` [12999.0, 14257.0, 14569.0, 14617.0, 14623.0, 14621.0] ``` Rather than evaluating `mem_usage_history[4] - mem_usage_history[1] < 180.0`, we will now measure 10 points, and begin our examination from the midpoint of these points (`mem_usage_history[5] - mem_usage_history[9] < 180.0`). This change addresses #595. Authors: - Gigon Bae (https://github.com/gigony) Approvers: - https://github.com/jakirkham URL: #601
- Loading branch information