Upgrade Copr builders to Fedora 39

[praiskup]

Fedora 39 is out now, we should move from the current Fedora 38 golden images.

[nikromen]

this needs to be done as well - #3053

[nikromen]

please skip s390x images for IBM cloud (internal ones)

[FrostyX]

Mainly just notes for myself.

• I wasn't able to get s390x (Fedora Copr) working yet.
• There is a temporary s390x VM on 52.117.124.71 which we need to kill somehow
• The runtest-custom-method.sh test fails because of

INFO: Package manager dnf5 detected and used (direct choice)
Start: installing minimal buildroot with dnf5
execv(/usr/bin/dnf5) failed: No such file or directory
WARNING: DNF5 command failed, retrying, attempt #2, sleeping 10s
execv(/usr/bin/dnf5) failed: No such file or directory
WARNING: DNF5 command failed, retrying, attempt #3, sleeping 10s
execv(/usr/bin/dnf5) failed: No such file or directory

I am not yet sure if this is related to the update or not ... turns out it wasn't related.

• The runtest-openmandriva.sh is still failing because of i686 chroots. Looks like the configs are broken. I will create/ping Mock issue or disable them if they are not supported anymore

Relevant issue: rpm-software-management/mock#1012
I am disabling the tests.

• The runtest.sh is failing, I need to figure out why

It is because of we generate wrong Mock config somewhere ... it has baseurl=/api_3/project-chroot/build-config instead of an actual baseurl which contains e.g. results/@copr/TEST1706981444241158807MockConfigParent

[FrostyX]

execv(/usr/bin/dnf5) failed: No such file or directory

Maybe this is caused by #3132?

[praiskup]

execv(/usr/bin/dnf5) failed: No such file or directory

Maybe this is caused by #3132?

I don't know. Seems like the bootstrap chroot was, for some reason, pregenerated with config_opts["package_manager"] = 'dnf' instead of dnf5. Then, there's the bug and RFE.

[FrostyX]

I don't know. Seems like the bootstrap chroot was, for some reason, pregenerated with config_opts["package_manager"] = 'dnf' instead of dnf5.

That seems to be the case. When I SSH on a builder and check /etc/mock/templates/fedora-branched.tpl, there is

config_opts['package_manager'] = 'dnf'

We have the following packages there:

mock-5.4-1.fc39.noarch
mock-core-configs-39.4-1.fc39.noarch

Edit: Rawhide has dnf5 though

[FrostyX]

Builders successfully updated:
https://lists.fedoraproject.org/archives/list/[email protected]/thread/AU2C4QTGE4L4HV7JDGJ4ALJDBSMBNBF6/