We have Fedora CI jobs that are taking long time to create the PODs, for example
https://jenkins-continuous-infra.apps.ci.centos.org/view/Fedora%20All%20Packages%20Pipeline/job/fedora-rawhide-build-pipeline/5591/console
The problem seems to be when the PODs try to run on n22.kempty.ci.centos.org
It might be something similar to https://pagure.io/fedora-infrastructure/issue/8063
Seeing this also ... All pods in pending state ...
This is blocking our FLOCK efforts :(
Seems insufficient space ...
Failed to pull image "quay.io/testing-farm/cruncher": rpc error: code = 2 desc = failed to register layer: devmapper: Thin Pool has 45187 free data blocks which is less than minimum required 45343 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
The people who can deal with this are currently traveling to FLOCK. I will assign but there is little I can do.
Metadata Update from @smooge: - Issue assigned to siddharthvipul1 - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: ci, outage
This node is cordoned for now.
Closing the outage. But fixing the cause.
Metadata Update from @bstinson: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.