Devdeps CI job is failing.

[WilliamJamieson]

Between the jobs (for #704):

• https://github.com/spacetelescope/romancal/actions/runs/5661779177/job/15340406708 (PR action run)
• https://github.com/spacetelescope/romancal/actions/runs/5670945339/job/15366991545 (Merge action run)

The devdeps job has begun to fail.

I suspect that this is partially the result of a recent numpy 2.0.dev release.

[WilliamJamieson]

Working pip freeze

py311-devdeps: commands_pre[1]> pip freeze
asdf @ git+https://github.com/asdf-format/asdf@1e9a0497f80fa1a13c496a1727049af5a5ebae5d
asdf-astropy @ git+https://github.com/astropy/asdf-astropy@0c502517a5cca9a6ce03150ad0c6472ae12a2e1f
asdf-coordinates-schemas==0.2.0
asdf-standard==1.0.3
asdf-transform-schemas @ git+https://github.com/asdf-format/asdf-transform-schemas@992fa8c47a68a2e31fe8c350aa0666cc7602f681
asdf-unit-schemas==0.1.0
asdf-wcs-schemas @ git+https://github.com/asdf-format/asdf-wcs-schemas@646bdff47b3d90a378308c118ad4de6e7bd9c96d
astropy @ git+https://github.com/astropy/astropy@d827727cb007ae398da57a1609bfd9944dff08ba
astropy-iers-data==0.2023.7.24.0.33.15
attrs==23.1.0
certifi==2023.7.22
charset-normalizer==3.2.0
ci-watson==0.6.1
coverage==7.2.7
crds==11.17.2
filelock==3.12.2
gwcs @ git+https://github.com/spacetelescope/gwcs@929478d8152574699e57e5498a2e4c079583a1e4
hypothesis==6.82.0
idna==3.4
importlib-metadata==6.8.0
iniconfig==2.0.0
jmespath==1.0.1
jsonschema==4.17.3
numpy==2.0.0.dev0
opencv-python-headless==4.8.0.74
packaging==23.1
Parsley==1.3
photutils==1.8.0
pluggy==1.2.0
psutil==5.9.5
pyerfa==2.0.0.3
pyparsing==3.1.0
pyrsistent==0.19.3
pytest==7.4.0
pytest-arraydiff==0.5.0
pytest-astropy==0.10.0
pytest-astropy-header==0.2.2
pytest-cov==4.1.0
pytest-doctestplus==0.13.0
pytest-filter-subpackage==0.1.2
pytest-mock==3.11.1
pytest-openfiles==0.5.0
pytest-remotedata==0.4.0
PyYAML==6.0.1
rad @ git+https://github.com/spacetelescope/rad.git@e95fe61c450d8f8afe62896b4922b42d4689d032
requests==2.31.0
roman-datamodels @ git+https://github.com/spacetelescope/roman_datamodels.git@177385062f1bef262253a916498a34ad5db0aa72
romancal @ file:///home/runner/work/romancal/romancal/.tox/.tmp/package/1/romancal-0.10.1.dev229%2Bg05efad4.tar.gz#sha256=cc29f821255036f5f85b6f5b2008e1d6ca7d3a402f2659b648412845187a058f
scipy==1.12.0.dev0
semantic-version==2.10.0
sortedcontainers==2.4.0
spherical-geometry==1.2.23
stcal @ git+https://github.com/spacetelescope/stcal@b3a98f7078ae7a7e1460[281](https://github.com/spacetelescope/romancal/actions/runs/5661779177/job/15340406708?pr=704#step:10:282)bb139e91408a1e882
stpipe @ git+https://github.com/spacetelescope/stpipe@6f84b52ffcce764a94806a35f5aefd28f3e8f8eb
stsci.imagestats==1.6.3
stsci.stimage==0.2.6
tweakwcs @ git+https://github.com/spacetelescope/tweakwcs@a9bf1b1758024980cfc5a2a2af2369e8c52b0562
urllib3==2.0.4
zipp==3.16.2

Failing pip freeze

py311-devdeps: commands_pre[1]> pip freeze
asdf @ git+https://github.com/asdf-format/asdf@1e9a0497f80fa1a13c496a1727049af5a5ebae5d
asdf-astropy @ git+https://github.com/astropy/asdf-astropy@17bd2edb5dd67[279](https://github.com/spacetelescope/romancal/actions/runs/5670945339/job/15366991545#step:10:280)f94ed3cf6189d7288dc68863
asdf-coordinates-schemas==0.2.0
asdf-standard==1.0.3
asdf-transform-schemas @ git+https://github.com/asdf-format/asdf-transform-schemas@992fa8c47a68a2e31fe8c350aa0666cc7602f681
asdf-unit-schemas==0.1.0
asdf-wcs-schemas @ git+https://github.com/asdf-format/asdf-wcs-schemas@646bdff47b3d90a378308c118ad4de6e7bd9c96d
astropy @ git+https://github.com/astropy/astropy@d827727cb007ae398da57a1609bfd9944dff08ba
astropy-iers-data==0.2023.7.24.0.33.15
attrs==23.1.0
certifi==2023.7.22
charset-normalizer==3.2.0
ci-watson==0.6.1
coverage==7.2.7
crds==11.17.2
filelock==3.12.2
gwcs @ git+https://github.com/spacetelescope/gwcs@929478d8152574699e57e5498a2e4c079583a1e4
hypothesis==6.82.0
idna==3.4
importlib-metadata==6.8.0
iniconfig==2.0.0
jmespath==1.0.1
jsonschema==4.17.3
numpy==2.0.0.dev0
opencv-python-headless==4.8.0.74
packaging==23.1
Parsley==1.3
photutils==1.8.0
pluggy==1.2.0
psutil==5.9.5
pyerfa==2.0.0.3
pyparsing==3.1.0
pyrsistent==0.19.3
pytest==7.4.0
pytest-arraydiff==0.5.0
pytest-astropy==0.10.0
pytest-astropy-header==0.2.2
pytest-cov==4.1.0
pytest-doctestplus==0.13.0
pytest-filter-subpackage==0.1.2
pytest-mock==3.11.1
pytest-openfiles==0.5.0
pytest-remotedata==0.4.0
PyYAML==6.0.1
rad @ git+https://github.com/spacetelescope/rad.git@e95fe61c450d8f8afe62896b4922b42d4689d032
requests==2.31.0
roman-datamodels @ git+https://github.com/spacetelescope/roman_datamodels.git@177385062f1bef262253a916498a34ad5db0aa72
romancal @ file:///home/runner/work/romancal/romancal/.tox/.tmp/package/1/romancal-0.10.1.dev183%2Bgcd7bb60.tar.gz#sha256=6a0d97d11f7cfbfdc19ca33d2e26f055929a9ebcdb5c8e8cfb9afcf6e0624af2
scipy==1.12.0.dev0
semantic-version==2.10.0
sortedcontainers==2.4.0
spherical-geometry==1.2.23
stcal @ git+https://github.com/spacetelescope/stcal@b3a98f7078ae7a7e1460[281](https://github.com/spacetelescope/romancal/actions/runs/5670945339/job/15366991545#step:10:282)bb139e91408a1e882
stpipe @ git+https://github.com/spacetelescope/stpipe@6f84b52ffcce764a94806a35f5aefd28f3e8f8eb
stsci.imagestats==1.6.3
stsci.stimage==0.2.6
tweakwcs @ git+https://github.com/spacetelescope/tweakwcs@a9bf1b1758024980cfc5a2a2af2369e8c52b0562
urllib3==2.0.4
zipp==3.16.2

Initial inspection indicates that the only package from this list that has changed is asdf-astropy. However, both the numpy and scipy dependencies for this test are derived from the scientific python nightly wheels.

Since both of these test runs had no changes to romancal itself between them, this indicates that the only changes that could be causing this are those in asdf-astropy, numpy, and scipy.

[WilliamJamieson]

Local testing rules out asdf-astropy.

[WilliamJamieson]

It appears that scipy cannot be the issue either as https://anaconda.org/scientific-python-nightly-wheels/scipy/files indicates wheel was last changed on July 22, 2023, which was before either of these test runs. So both runs where using the same version of numpy.

Similarly, https://anaconda.org/scientific-python-nightly-wheels/numpy/files indicates that numpy had a wheel upload between the passing and failing run. This means the only code change between the two CI runs is due to the new numpy wheel.

[WilliamJamieson]

Numpy wheels are updated via a scheduled action on GitHub. Searching the numpy actions indicate that the functional wheel was uploaded by: https://github.com/numpy/numpy/actions/runs/5634112807.

[schlafly]

This issue is stale, closing.