Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gdal-master conda builds: authentication token has expired #11676

Closed
dbaston opened this issue Jan 16, 2025 · 6 comments
Closed

gdal-master conda builds: authentication token has expired #11676

dbaston opened this issue Jan 16, 2025 · 6 comments
Assignees

Comments

@dbaston
Copy link
Member

dbaston commented Jan 16, 2025

What is the bug?

See https://github.com/OSGeo/gdal/actions/runs/12811487435/job/35720962934#step:10:1057

Steps to reproduce the issue

required text

Versions and provenance

master

Additional context

No response

@rouault rouault self-assigned this Jan 16, 2025
@rouault
Copy link
Member

rouault commented Jan 16, 2025

I've regenerated a new token in https://anaconda.org/gdal-master/settings/access with an expiration date in 2050 ! and updated it in the ANACONDA_TOKEN variable of https://github.com/OSGeo/gdal/settings/secrets/actions . Restarting the jobs to check if that works

@rouault
Copy link
Member

rouault commented Jan 16, 2025

builds (at least on Mac) fail another reason (cf https://github.com/OSGeo/gdal/actions/runs/12814810505/job/35736273596). Perhaps the next refresh of the build from upstream https://github.com/conda-forge/gdal-feedstock will fix it ...

@dbaston
Copy link
Member Author

dbaston commented Jan 17, 2025

Similar failure is discussed here conda/conda-build#5594

@rouault
Copy link
Member

rouault commented Jan 17, 2025

ok, so conda build issue has been fixed upstream (cf conda-forge/gdal-feedstock#1041 (comment)), but the upload of our packages doesn't work, and I've no idea why

compare successfull build of https://github.com/OSGeo/gdal/actions/runs/12606126439/job/35135828816 with logs like

Anaconda token is available, attempting to upload
[ ... lots of things ....]
Preparing transaction: - ��\ ��done
Verifying transaction: / ��- ��\ ��| ��/ ��- ��\ ��| ��done
Executing transaction: - ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��done
Using Anaconda API: https://api.anaconda.org/
Warning: [WARNING] Token warning: expires in 5 days
Using "gdal-master" as upload username
Processing "./packages/linux-64/libgdal-adbc-3.10.0-h9ca9e27_2112.tar.bz2"
Detecting file type...
File type is "Conda"
Extracting conda attributes for upload
Warning:  Distribution "linux-64/libgdal-adbc-3.10.0-h9ca9e27_2112.tar.bz2" already exists. Removing.
Creating package "libgdal-adbc"
Creating release "3.10.0"
Uploading file "gdal-master/libgdal-adbc/3.10.0/linux-64/libgdal-adbc-3.10.0-h9ca9e27_2112.tar.bz2"

  0%|          | 0.00/496k [00:00<?, ?B/s]
  3%|▎         | 16.0k/496k [00:00<00:04, 102kB/s]
 29%|██▉       | 144k/496k [00:00<00:00, 582kB/s] 
501kB [00:00, 1.53MB/s]                          
501kB [00:00, 730kB/s] 
Upload complete

conda located at:
  https://anaconda.org/gdal-master/libgdal-adbc
...

and latest build of https://github.com/OSGeo/gdal/actions/runs/12830442466/job/35778643064 where the step stops after "Executing transaction", but no attempt to upload the package

Anaconda token is available, attempting to upload
[ ... lots of things ....
Preparing transaction: - ��\ ��done
Verifying transaction: / ��- ��\ ��| ��/ ��done
Executing transaction: \ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��/ ��- ��\ ��| ��done

https://anaconda.org/gdal-master/settings/access shows that the new token hasn't been accessed at all... I've just repasted it in github repository secrets in case I messed up something yesterday...

@rouault
Copy link
Member

rouault commented Jan 17, 2025

ok, found the reason the last successfull build had a warning:

2025-01-04T01:13:22.4654582Z /home/runner/miniconda3/envs/test/lib/python3.12/site-packages/conda_build/cli/main_build.py:520: FutureWarning: The default `pkg_format` of '.tar.bz2' is deprecated and will be removed in 25.1. 
2025-01-04T01:13:22.4655579Z 
2025-01-04T01:13:22.4655938Z The new default `pkg_format` value will be '.conda'. If you want to keep using `.tar.bz2`, consider:
2025-01-04T01:13:22.4656846Z - Setting `conda_build.pkg_format: 'tar.bz2' in your condarc file.
2025-01-04T01:13:22.4657562Z - Using `--pkg-format=tar.bz2` in the CLI.
2025-01-04T01:13:22.4657835Z 

ah the joy of cumulating 2 separate issues at the same time !

Should be fixed per 3da6544

rouault added a commit to rouault/gdal that referenced this issue Jan 17, 2025
As shown in OSGeo#11676 our current
strategy is to always consider the upload stage to have succeeded.
Change that to fail on errors, or lack of packages to upload.
rouault added a commit to rouault/gdal that referenced this issue Jan 17, 2025
As shown in OSGeo#11676 our current
strategy is to always consider the upload stage to have succeeded.
Change that to fail on errors, or lack of packages to upload.
@rouault
Copy link
Member

rouault commented Jan 17, 2025

confirmed: uploads back to normal : https://anaconda.org/gdal-master/gdal/files

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants