Sorry for bothering you so much today, I have hit yet another issue.
Recently, we made a mistake in koji-osbuild that causes not all versions of the builder plugin and the hub plugin are compatible between each other. Basically, version <=8 hub plugin cannot talk to version >=9 builder plugin.
By inspecting logs from my recent image build attemps, I think that the staging hub is running version 8 (or earlier), whereas the staging builder is running version 9 (or later), which is exactly the broken combination.
I would like to apologize for this mess, this is completely our fault.
Sync versions of koji-osbuild-hub on koji hubs and koji-osbuild-builder on koji builders.
Ideally, they should be able all version 10 (released in all Fedoras). Also, it would be great if this was done on both staging and prod.
The risk of updating is pretty minimal. I have trust in our testing pipeline that shows that everything works well when the versions are in sync. Note that we will do our best not to break it again.
Thanks!
Will update/reboot them all. :)
Done. Please test.
Thanks a ton! My tasks are in stuck in the queue behind the kojira ones, so this will take a while, I will check the results tomorrow.
Alright. Fingers crossed.
It works, thanks a lot, Kevin! :) Did you do production as well?
Metadata Update from @zlopez: - Issue assigned to kevin - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: low-trouble, medium-gain, ops
prod is also done.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Log in to comment on this ticket.