unable to run run tox and fails with error "could not install deps"

[AvRajath]

Im trying to run UTs in my Ubuntu machine(16.04). but im seeing the dependency error although i have installed the dependencies locally.

Below is the error when i run sudo tox:

$ tox -vvvv -ini
using tox.ini: /home/dev/rajath/openstack/git/networking-infoblox/tox.ini (pid 119214)
using tox-3.23.1 from /home/dev/.local/lib/python3.6/site-packages/tox/__init__.py (pid 119214)
skipping sdist step
py36 uses /usr/bin/python3.6
py36 start: getenv /home/dev/rajath/openstack/git/networking-infoblox/.tox/py36
py36 cannot reuse: no previous config /home/dev/rajath/openstack/git/networking-infoblox/.tox/py36/.tox-config1
py36 create: /home/dev/rajath/openstack/git/networking-infoblox/.tox/py36
setting PATH=/home/dev/rajath/openstack/git/networking-infoblox/.tox/py36/bin:/home/dev/bin:/home/dev/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
[119226] /home/dev/rajath/openstack/git/networking-infoblox/.tox$ /usr/bin/python3.6 -m virtualenv --no-download --python /usr/bin/python3.6 py36
/home/dev/.local/lib/python3.6/site-packages/virtualenv/run/plugin/base.py:18: DeprecationWarning: SelectableGroups dict interface is deprecated. Use select.
  return OrderedDict((e.name, e.load()) for e in cls.entry_points().get(key, {}))
created virtual environment CPython3.6.13.final.0-64 in 241ms
  creator CPython3Posix(dest=/home/dev/rajath/openstack/git/networking-infoblox/.tox/py36, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/home/dev/.local/share/virtualenv)
    added seed packages: pip==21.1.2, setuptools==57.0.0, wheel==0.36.2
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
py36 installdeps: -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt
setting PATH=/home/dev/rajath/openstack/git/networking-infoblox/.tox/py36/bin:/home/dev/bin:/home/dev/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
ERROR: invocation failed (exit code 13)
ERROR: could not install deps [-r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt]; v = InvocationError('/home/dev/rajath/openstack/git/networking-infoblox/tools/tox_install.sh -i ni -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt', 13)
py36 finish: getenv /home/dev/rajath/openstack/git/networking-infoblox/.tox/py36 after 0.41 seconds
/usr/bin/python3.6 (/usr/bin/python3.6) is {'executable': '/usr/bin/python3.6', 'implementation': 'CPython', 'version_info': [3, 6, 13, 'final', 0], 'version': '3.6.13 (default, Feb 20 2021, 21:42:50) \n[GCC 5.4.0 20160609]', 'is_64': True, 'sysplatform': 'linux', 'os_sep': '/', 'extra_version_info': None}
pep8 uses /usr/bin/python3.6
pep8 start: getenv /home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8
pep8 cannot reuse: no previous config /home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8/.tox-config1
pep8 create: /home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8
setting PATH=/home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8/bin:/home/dev/bin:/home/dev/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
[119234] /home/dev/rajath/openstack/git/networking-infoblox/.tox$ /usr/bin/python3.6 -m virtualenv --no-download --python /usr/bin/python3.6 pep8
/home/dev/.local/lib/python3.6/site-packages/virtualenv/run/plugin/base.py:18: DeprecationWarning: SelectableGroups dict interface is deprecated. Use select.
  return OrderedDict((e.name, e.load()) for e in cls.entry_points().get(key, {}))
created virtual environment CPython3.6.13.final.0-64 in 224ms
  creator CPython3Posix(dest=/home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/home/dev/.local/share/virtualenv)
    added seed packages: pip==21.1.2, setuptools==57.0.0, wheel==0.36.2
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
pep8 installdeps: -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt
setting PATH=/home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8/bin:/home/dev/bin:/home/dev/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
ERROR: invocation failed (exit code 13)
ERROR: could not install deps [-r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt]; v = InvocationError('/home/dev/rajath/openstack/git/networking-infoblox/tools/tox_install.sh -i ni -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt', 13)
pep8 finish: getenv /home/dev/rajath/openstack/git/networking-infoblox/.tox/pep8 after 0.40 seconds
___________________________________________________________ summary ___________________________________________________________
ERROR:   py36: could not install deps [-r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt]; v = InvocationError('/home/dev/rajath/openstack/git/networking-infoblox/tools/tox_install.sh -i ni -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt', 13)
ERROR:   pep8: could not install deps [-r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt, -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt]; v = InvocationError('/home/dev/rajath/openstack/git/networking-infoblox/tools/tox_install.sh -i ni -r/home/dev/rajath/openstack/git/networking-infoblox/requirements.txt -r/home/dev/rajath/openstack/git/networking-infoblox/test-requirements.txt', 13)

$ cat tox.ini
[tox]
envlist = py36,pep8
skipsdist = True

[testenv]
usedevelop = True
install_command = {toxinidir}/tools/tox_install.sh {opts} {packages}
setenv =
   VIRTUAL_ENV={envdir}
   PYTHONWARNINGS=default::DeprecationWarning
   UPPER_CONSTRAINTS_FILE=https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?h=stable/wallaby
   BRANCH_NAME=stable/wallaby

deps = -r{toxinidir}/requirements.txt
       -r{toxinidir}/test-requirements.txt
commands = python setup.py test --slowest --testr-args='{posargs}'

[testenv:pep8]
commands =
    flake8
    neutron-db-manage --subproject networking-infoblox check_migration

[testenv:venv]
commands = {posargs}

[testenv:cover]
commands = python setup.py test --coverage --testr-args='{posargs}'

[testenv:docs]
commands = python setup.py build_sphinx

[testenv:debug]
commands = oslo_debug_helper {posargs}

[testenv:py34]
commands = python -m testtools.run \
    networking_infoblox.tests.test_networking_infoblox

[flake8]
# E123, E125 skipped as they are invalid PEP-8.

show-source = True
ignore = E123,E125
builtins = _
exclude=.venv,.git,.tox,dist,doc,*lib/python*,*egg,build

[AvRajath]

https://github.com/AvRajath/networking-infoblox this is the repo that im trying to run tox on.

[jugmac00]

Pinging the the other maintainers (@gaborbernat, @obestwalter, @asottile, @eumiro), whether Bash scripts are a supported option for the install_command at all.

When I look in our documentation, I don't think so:
https://tox.readthedocs.io/en/latest/config.html#conf-install_command

I even tried to run a very basic Bash script for the install_command, and I see the same error.

Maybe some of the plugins could help, see https://tox.readthedocs.io/en/latest/plugins.html or you need to write a custom one.

[asottile]

yes this should work, I've used this approach before

but your file isn't executable:

$ ls -al tools/
total 12
drwxr-xr-x 2 asottile asottile 4096 Jun  3 08:10 .
drwxr-xr-x 8 asottile asottile 4096 Jun  3 08:10 ..
-rw-r--r-- 1 asottile asottile 1509 Jun  3 08:10 tox_install.sh

here's a video I did on checking in an executable file (in case you're on windows): https://youtu.be/Ud6t-mIyhsw

[jugmac00]

Thanks @asottile!

Let's keep this issue open until this feature is documented.

@AvRajath, maybe you want to create a pull request, now that you know how this works?