Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restarted after failure crashes #118

Open
nickyruggs opened this issue Jan 26, 2024 · 1 comment
Open

Restarted after failure crashes #118

nickyruggs opened this issue Jan 26, 2024 · 1 comment

Comments

@nickyruggs
Copy link

nickyruggs commented Jan 26, 2024

After the failure with the proxyusers privilege, restarting the script failed at the end...

[INFO] Creating the HTTP proxy user with the following members: cloudera-scm (user)...
[INFO] Flushing the auth cache...
Exception ignored in: <function ApiClient.__del__ at 0x7f00c29eedc0>
Traceback (most recent call last):
  File "/root/.local/share/pipx/venvs/isilon-hadoop-tools/lib/python3.8/site-packages/isi_sdk_8_2_2/api_client.py", line 89, in __del__
    self.pool.close()
  File "/usr/local/lib/python3.8/multiprocessing/pool.py", line 649, in close
    self._change_notifier.put(None)
  File "/usr/local/lib/python3.8/multiprocessing/queues.py", line 368, in put
    self._writer.send_bytes(obj)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor
Exception ignored in: <function ApiClient.__del__ at 0x7f00c29eedc0>
Traceback (most recent call last):
  File "/root/.local/share/pipx/venvs/isilon-hadoop-tools/lib/python3.8/site-packages/isi_sdk_8_2_2/api_client.py", line 89, in __del__
    self.pool.close()
  File "/usr/local/lib/python3.8/multiprocessing/pool.py", line 649, in close
    self._change_notifier.put(None)
  File "/usr/local/lib/python3.8/multiprocessing/queues.py", line 368, in put
    self._writer.send_bytes(obj)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor
Exception ignored in: <function ApiClient.__del__ at 0x7f00c29eedc0>
Traceback (most recent call last):
  File "/root/.local/share/pipx/venvs/isilon-hadoop-tools/lib/python3.8/site-packages/isi_sdk_8_2_2/api_client.py", line 89, in __del__
    self.pool.close()
  File "/usr/local/lib/python3.8/multiprocessing/pool.py", line 649, in close
    self._change_notifier.put(None)
  File "/usr/local/lib/python3.8/multiprocessing/queues.py", line 368, in put
    self._writer.send_bytes(obj)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor
Exception ignored in: <function ApiClient.__del__ at 0x7f00c29eedc0>
Traceback (most recent call last):
  File "/root/.local/share/pipx/venvs/isilon-hadoop-tools/lib/python3.8/site-packages/isi_sdk_8_2_2/api_client.py", line 89, in __del__
    self.pool.close()
  File "/usr/local/lib/python3.8/multiprocessing/pool.py", line 649, in close
    self._change_notifier.put(None)
  File "/usr/local/lib/python3.8/multiprocessing/queues.py", line 368, in put
    self._writer.send_bytes(obj)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor
Exception ignored in: <function ApiClient.__del__ at 0x7f00c29eedc0>
Traceback (most recent call last):
  File "/root/.local/share/pipx/venvs/isilon-hadoop-tools/lib/python3.8/site-packages/isi_sdk_8_2_2/api_client.py", line 89, in __del__
    self.pool.close()
  File "/usr/local/lib/python3.8/multiprocessing/pool.py", line 649, in close
    self._change_notifier.put(None)
  File "/usr/local/lib/python3.8/multiprocessing/queues.py", line 368, in put
    self._writer.send_bytes(obj)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 200, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor
[root@cdp-demo-m ~]# 
@tucked
Copy link
Member

tucked commented Jan 26, 2024

This has been raised internally before:

this is a known issue multiproccesing.pool() python library , no work required on SDK front .

AFAIK it's innocuous and has not been seen on Python 3.9+

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants