AATH "acapy-main" build failing -- seems to be an issue with finding the right version of ConfigArgParse?

[swcurran]

When I try to build the acapy-main AATH Test Agent (commands git clone https://github.com/hyperledger/aries-agent-test-harness; cd aries-agent-test-harness; ./manage rebuild -a acapy-main, the process does not seem to complete.

I get a the following errors:

INFO: pip is looking at multiple versions of configargparse to determine which version is compatible with other requirements. This could take a while.
Collecting ConfigArgParse
  Downloading ConfigArgParse-1.5.2-py3-none-any.whl (20 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
  Downloading ConfigArgParse-1.5.1-py3-none-any.whl (20 kB)
  Downloading ConfigArgParse-1.5-py3-none-any.whl (19 kB)
  Downloading ConfigArgParse-1.4.1-py3-none-any.whl (19 kB)
    Downloading ConfigArgParse-1.4.tar.gz (45 kB)
  Downloading ConfigArgParse-1.3.tar.gz (43 kB)
  Downloading ConfigArgParse-1.2.3.tar.gz (42 kB)
INFO: pip is looking at multiple versions of configargparse to determine which version is compatible with other requirements. This could take a while.
  Downloading ConfigArgParse-1.2.2.tar.gz (42 kB)
  Downloading ConfigArgParse-1.2.1.tar.gz (42 kB)
  Downloading ConfigArgParse-1.2.tar.gz (42 kB)
  Downloading ConfigArgParse-1.1.tar.gz (41 kB)
  Downloading ConfigArgParse-1.0.1.tar.gz (41 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
  Downloading ConfigArgParse-1.0.tar.gz (40 kB)
  Downloading ConfigArgParse-0.15.2.tar.gz (27 kB)
  Downloading ConfigArgParse-0.15.1.tar.gz (27 kB)
  Downloading ConfigArgParse-0.15.tar.gz (27 kB)
  Downloading ConfigArgParse-0.14.0.tar.gz (26 kB)
  Downloading ConfigArgParse-0.13.0.tar.gz (31 kB)
  Downloading ConfigArgParse-0.12.0.tar.gz (41 kB)
  Downloading ConfigArgParse-0.11.0.tar.gz (40 kB)
  Downloading ConfigArgParse-0.10.0.tar.gz (36 kB)
  Downloading ConfigArgParse-0.9.3.tar.gz (18 kB)
  Downloading ConfigArgParse-0.9.2.tar.gz (13 kB)
  Downloading ConfigArgParse-0.9.1.tar.gz (16 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-a17ypb7c/configargparse_02525a06fbb84c85b8acf2b1a227149e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-a17ypb7c/configargparse_02525a06fbb84c85b8acf2b1a227149e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-2sd6bpp8
         cwd: /tmp/pip-install-a17ypb7c/configargparse_02525a06fbb84c85b8acf2b1a227149e/
    Complete output (1 lines):
    ERROR: pypandoc module not found, could not convert Markdown to RST for PyPI
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/16/d9/b35fe00867051e98d328d0e5d9d2f1c79b1301f7a8cb8ea628bf5358db65/ConfigArgParse-0.9.1.tar.gz#sha256=1ad61967d5c7eef9005f8e92a7f363dca579ce4c3dc237e98393333914f253e4 (from https://pypi.org/simple/configargparse/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Downloading ConfigArgParse-0.9.tar.gz (16 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-a17ypb7c/configargparse_6202572f89544f76bfa996dc2e22ccd0/setup.py'"'"'; __file__='"'"'/tmp/pip-install-a17ypb7c/configargparse_6202572f89544f76bfa996dc2e22ccd0/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-5u2u447j
         cwd: /tmp/pip-install-a17ypb7c/configargparse_6202572f89544f76bfa996dc2e22ccd0/
    Complete output (1 lines):
    ERROR: pypandoc module not found, could not convert Markdown to RST for PyPI
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/0a/f5/7923440cec8e830c44ddcd4185d362ebd239f9eab40b510108423b176ba8/ConfigArgParse-0.9.tar.gz#sha256=9686cc2fbd83a313c53c143fcb8a5222bf4764f4ea7d66a773ce1e18d94e31d9 (from https://pypi.org/simple/configargparse/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

The job continues, but seems to hang here:

INFO: pip is looking at multiple versions of asynctest to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of aiohttp to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of ptvsd to determine which version is compatible with other requirements. This could take a while.
Collecting ptvsd
  Downloading ptvsd-4.3.1-cp37-cp37m-manylinux1_x86_64.whl (5.9 MB)
  Downloading ptvsd-4.3.0-cp37-cp37m-manylinux1_x86_64.whl (5.7 MB)

[swcurran]

@andrewwhitehead @dbluhm -- help! :-).

Perhaps this is intermittent or something to do with downloading files. However, I'm not sure I've ever seen these messages INFO: pip is looking at multiple versions of asynctest to determine which version is compatible....

If it is something in the changes -- I'm guessing it would be something to do with #1833, as perhaps that impacts ConfigArgParse since it is in that area. But that seems to be a stretch.

Perhaps a change to the version of pip?

Sigh...

[swcurran]

@nodlesh -- FYI -- none of the ACA-Py tests ran today because of this issue.

[swcurran]

Tried a few things that didn't impact.

• @andrewwhitehead mentioned that ACA-Py was using Python 3.6, but I noticed that the base image for the ACA-Py Main Test Agent is using Python 3.7. Changed to 3.6 and got the same build error.
• To verify the issue was not in the ACA-Py changes, ran the rebuild process based on the the 0.7.4-rc4 tag, which had previously worked. Got the same build error.
• No changes have been made in the AATH repo in the past 7 days.

So it appears to be something that changed in the environment.

[swcurran]

After some playing around, we determined that the error was not with ConfigArgParse, but rather with a recent merge done for this PR sicpa-dlab/acapy-resolver-universal#16 in the ACA-Py Resolver. That changed locked the ACA-Py version to 0.7.3, which conflicted with the requirement that ACA-Py be at whatever is current on the "main" branch.

Temporary fix to lock https://github.com/sicpa-dlab/acapy-resolver-universal to the commit prior to the merge of the PR above. We'll sort out with those folks how to resolve this long term.