Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huge traceback errors when running find_sources in python 3.9.17 #502

Open
ddobie opened this issue Sep 26, 2023 · 0 comments
Open

Huge traceback errors when running find_sources in python 3.9.17 #502

ddobie opened this issue Sep 26, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@ddobie
Copy link
Collaborator

ddobie commented Sep 26, 2023

When using find_sources in python 3.9.17 there are huge errors of the form of

Traceback (most recent call last):
OSError: handle is closed
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/site-packages/multiprocessing_logging.py", line 78, in _receive
    if self._is_closed and self.queue.empty():
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/queues.py", line 129, in empty
    return not self._poll()
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 255, in poll
    self._check_closed()
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 136, in _check_closed
    raise OSError("handle is closed")
Traceback (most recent call last):
OSError: handle is closed
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/site-packages/multiprocessing_logging.py", line 78, in _receive
    if self._is_closed and self.queue.empty():
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/queues.py", line 129, in empty
    return not self._poll()
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 255, in poll
    self._check_closed()
Traceback (most recent call last):
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 136, in _check_closed
    raise OSError("handle is closed")
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/site-packages/multiprocessing_logging.py", line 78, in _receive
    if self._is_closed and self.queue.empty():
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/queues.py", line 129, in empty
    return not self._poll()
OSError: handle is closed
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 255, in poll
    self._check_closed()
  File "/home/ddobie/user-conda-envs/vast-tools-dev/lib/python3.9/multiprocessing/connection.py", line 136, in _check_closed
    raise OSError("handle is closed")
Fatal Python error: _enter_buffered_busy: could not acquire lock for <_io.BufferedWriter name='<stderr>'> at interpreter shutdown, possibly due to daemon threads
Python runtime state: finalizing (tstate=0x563f9d53c130)

Current thread 0x00007f504e3fa740 (most recent call first):
<no Python frame>
Aborted (core dumped)

whenever the script exits, regardless of whether that is due to an error or simply reaching the end of the script. I can't post the full traceback because it's so long, but the above is the gist of it.

The problem seems to be related to multiprocessing, but happens even when running with scheduler=single-threaded

@ddobie ddobie added the bug Something isn't working label Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant