except ConnectionResetError in MultiProcessingHandler (#770)

* except ConnectionResetError in MultiProcessingHandler * formatting * add changelog entry * Update cluster_tools/Changelog.md Co-authored-by: Philipp Otto <[email protected]> * adapt comment Co-authored-by: Philipp Otto <[email protected]>
scalableminds · Jul 22, 2022 · db7c5f0 · db7c5f0
1 parent 21b9eaf
commit db7c5f0
Show file tree

Hide file tree

Showing 2 changed files with 9 additions and 2 deletions.
diff --git a/cluster_tools/Changelog.md b/cluster_tools/Changelog.md
@@ -16,6 +16,7 @@ For upgrade instructions, please check the respective *Breaking Changes* section
 ### Changed
 
 ### Fixed
+- Suppress spurious ConnectionResetErrors when using multiprocessing. [#770](https://github.com/scalableminds/webknossos-libs/pull/770)
 
 
 ## [0.10.9](https://github.com/scalableminds/webknossos-libs/releases/tag/v0.10.9) - 2022-07-21

diff --git a/cluster_tools/cluster_tools/multiprocessing_logging_handler.py b/cluster_tools/cluster_tools/multiprocessing_logging_handler.py
@@ -52,9 +52,15 @@ def _receive(self) -> None:
                     self.wrapped_handler.emit(record)
             except (KeyboardInterrupt, SystemExit):  # pylint: disable=try-except-raise
                 raise
-            # multiprocessing.managers.RemoteError pop up quite often.
+            # The following errors pop up quite often.
             # It seems that they can be safely ignored, though.
-            except (BrokenPipeError, EOFError, multiprocessing.managers.RemoteError):
+            # The reason for those might be that the sending end was closed.
+            except (
+                BrokenPipeError,
+                EOFError,
+                ConnectionResetError,
+                multiprocessing.managers.RemoteError,
+            ):
                 break
             except QueueEmpty:
                 # This case is reached when the timeout in queue.get is hit. Pass, to