pungi

#693 RFE: ship deltarpm creation to the koji builders
Opened by dustymabe. Modified

Open
Close Issue

During our pungi+bodhi integration meeting today @lsedlar pointed out that pungi does not currently ship the deltarpm creation to the builder machines, but instead runs that on the machine where pungi was initiated. We'd like to ship this to the builder machines in the future so that the machine pungi is run from can be more lightweight.

side note: I don't know if this is possible or not but parallelizing the drpm creation such that multiple machines could chunk up and do part of the work would be really useful.

Currently Pungi just calls createrepo_c to make the repodata and deltas at the same time. We could move this call to runroot quite easily and run more of them in parallel. Currently they run on the compose box and we run three createrepo instances at the same time.

Splitting the delta creation across multiple machines would be much more work, as we would need to make them separately from calling createrepo.

Currently Pungi just calls createrepo_c to make the repodata and deltas at the same time. We could move this call to runroot quite easily and run more of them in parallel. Currently they run on the compose box and we run three createrepo instances at the same time.

cool

Splitting the delta creation across multiple machines would be much more work, as we would need to make them separately from calling createrepo.

yep - the path forward here is precomputing the drpms before pungi even gets called and storing them in a "lookaside cache", then having pungi pull in rpms from the cache that match before running drpm creation. If the drpm exists then it will be skipped during deltarpm creation.

the path forward here is precomputing the drpms before pungi even gets called

this is a totally separate work item unrelated to this ticket

This issue has been migrated to Fedora Forge:
https://forge.fedoraproject.org/pungi/pungi/issues/693

Please continue any further discussion there.
Metadata
None
None
None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.