#505 Zuul rpm-install-test: Could not resolve hostname for https://mirrors.fedoraproject
Opened by churchyard. Modified

In https://src.fedoraproject.org/rpms/python-tomli/pull-request/24 and https://src.fedoraproject.org/rpms/python-numpy-stl/pull-request/10 and https://src.fedoraproject.org/rpms/python-argcomplete/pull-request/37 (so assuming everywhere) I get:

Updating and loading repositories:
 Fedora - Rawhide - Developmental packa ???% |   0.0   B/s |   0.0   B |  00m00s
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject
>>> Librepo error: Cannot prepare internal mirrorlist: Curl error (6): Could not
Error checking if metalink "https://mirrors.fedoraproject.org/metalink?repo=rawhide&arch=x86_64" is in sync for repository "rawhide"
 Librepo error: Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=rawhide&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]

on Zuul rpm-install-test.


Thanks for the report. It seems to only affect rawhide image https://fedora.softwarefactory-project.io/zuul/builds?job_name=rpm-install-test&skip=0

The last successful rpm-install-test job on the rawhide image was at 2024-12-30 14:08:53 and from then (2024-12-30 20:05:17) the issue started to appear.

Investigating a bit more today, see this bugzilla https://bugzilla.redhat.com/show_bug.cgi?id=2333848

Thanks.

Having CI broken for a 6 days makes the CI useless. Just saying ...

The bug have been reported here
- https://bugzilla.redhat.com/show_bug.cgi?id=2333848
- https://bugzilla.redhat.com/show_bug.cgi?id=2333743

"CI broken" for the rawhide related tests. For other branches there is no such issue (https://fedora.softwarefactory-project.io/zuul/builds?branch=f41).

Any suggestion about how to fix ? an idea of workaround ?
https://fedoraproject.org/wiki/Zuul-based-ci#CI_config_repositories

Adding a workaround here https://pagure.io/fedora-zuul-jobs/blob/master/f/playbooks/rpm/rpm-install-test.yaml#_7 to restart systemd-resolved might perhaps help ?

I'll merge this https://pagure.io/fedora-zuul-jobs/pull-request/193
Then let see if that make it work.

This is merged, could you recheck a change on 'rawhide' ?

Trying in https://src.fedoraproject.org/rpms/uv/pull-request/28

I'm not 100% sure it's the same thing yet but CI in https://pagure.io/workstation-ostree-config/pull-request/601 is failing on something that looks similar:

Traceback (most recent call last):
  File "<stdin>", line 107, in <module>
  File "<stdin>", line 99, in _ansiballz_main
  File "<stdin>", line 47, in invoke_module
  File "<frozen runpy>", line 226, in run_module
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/tmp/ansible_ansible.legacy.dnf5_payload_hhmhci8z/ansible_ansible.legacy.dnf5_payload.zip/ansible/modules/dnf5.py", line 717, in <module>
  File "/tmp/ansible_ansible.legacy.dnf5_payload_hhmhci8z/ansible_ansible.legacy.dnf5_payload.zip/ansible/modules/dnf5.py", line 713, in main
  File "/tmp/ansible_ansible.legacy.dnf5_payload_hhmhci8z/ansible_ansible.legacy.dnf5_payload.zip/ansible/modules/dnf5.py", line 550, in run
  File "/usr/lib64/python3.13/site-packages/libdnf5/repo.py", line 2432, in load_repos
    return _repo.RepoSackWeakPtr_load_repos(self, *args)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
RuntimeError: Error checking if metalink "https://mirrors.fedoraproject.org/metalink?repo=rawhide&arch=x86_64" is in sync for repository "rawhide"

@siosm yes looks similar as it happen on rawhide image https://fedora.softwarefactory-project.io/zuul/build/5878f11318a34457874fd05b69afefa1/log/job-output.txt#49

The workaround that seems to work for now is to restart systemd-resolved early in your job like here : https://pagure.io/fedora-zuul-jobs/c/98eb089ef2bbe8abbd329c8b088bebeb90ed72da?branch=master

@churchyard it worked for that job https://fedora.softwarefactory-project.io/zuul/build/d3cc8c0a30f4488b87ce4e1b8e698522

Thank you!

Metadata Update from @churchyard:
- Issue status updated to: Closed (was: Open)

I think we should keep this one open until we have a full fix and can remove the workaround.

Metadata Update from @churchyard:
- Issue status updated to: Open (was: Closed)

Form the user's perspective, things are working.

But I don't mind keeping this open.

Metadata