[Bug] CI pipeline compatibility test failed in some case for unknown reason

[scarlet25151]

Search before asking

• I searched the issues and found no similar issues.

KubeRay Component

ci

What happened + What you expected to happen

https://github.com/ray-project/kuberay/runs/7219956579?check_suite_focus=true

As the links show, in the case that we make some changes, the test will failed, the latest part would be like:

INFO:__main__:executing cmd: kubectl apply -f tests/config/raycluster-service.yaml
service/ray-cluster-nodeport created
INFO:__main__:(b'1\n', None)
E/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=3, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=4, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=5, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=6, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=7, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/queue.py:133: ResourceWarning: unclosed <socket.socket fd=9, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  with self.not_full:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/http/client.py:422: ResourceWarning: unclosed <socket.socket fd=10, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  self._close_conn()
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/opt/hostedtoolcache/Python/3.10.5/x64/lib/python3.10/http/client.py:422: ResourceWarning: unclosed <socket.socket fd=11, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, raddr=/run/docker.sock>
  self._close_conn()
ResourceWarning: Enable tracemalloc to get the object allocation traceback
.INFO:__main__:executing cmd: kind delete cluster
Deleting cluster "kind" ...
======================================================================
ERROR: test_cluster_info (__main__.BasicRayTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/kuberay/kuberay/./tests/compatibility-test.py", line 169, in test_cluster_info
Error:     raise Exception('invalid result.')
Exception: invalid result.
----------------------------------------------------------------------
Ran 2 tests in 338.887s
FAILED (errors=1)
Error: Process completed with exit code 1.

Reproduction script

https://github.com/ray-project/kuberay/runs/7219956579?check_suite_focus=true
each time retrigger the ci by the pr #341

Anything else

/cc @wilsonwang371

Are you willing to submit a PR?

• Yes I am willing to submit a PR!