#11465 Plan for deploying koji-flatpak to staging
Closed: Fixed 2 years ago by kevin. Opened 2 years ago by otaylor.

Here's roughly what we need to do to get to the point where we're ready to deploy koji-flatpak (plugins for building non-modular Flatpaks directly on the koji builders with no OSBS) to production.

  1. [Done, update, build could be tagged into F38-infra] Build new flatpak-module-tools (1.0~a2 or newer) for F38. At the moment, it's only built for
    F39 and rawhide. The new flatpak-module-tools is incompatible at the command line level
    with the older version, but the python APi used by OSBS/atomic-reactor should be compatible.
    (The atomic-reactor tests pass against it.) Alternatively, build it only into f38-infra.

  2. [Done, update, build could be tagged into F38-infra]. Get koji-flatpak package reviewed and into F38 (Package review). Alternatively, build it only in f38-infra

  3. [Done, local builds against data verified to work]. Sync production koji to staging (playbooks/manual/staging-sync/koji.yml).
    This isn't strictly necessary, but avoids having to manually fix up the tag setup for f39-flatpak-*,
    and means that the Flatpak content is more likely to build directly from dist-git without modification.

  4. Edit ansible configuration to add koji-flatpak-hub to roles/koji_hub/tasks/main.yml and
    koji-flatpak-builder to roles/koji_builder/tasks/main.yml conditional only for staging and deploy configuration to staging hub and builders.

  5. Configure /etc/kojid/plugins/flatpak.conf to point to the candidate staging registry, and add login-registry role so that the builder nodes can push to the candidate registry. (See flatpak-koji/README.md).

  6. Test building a Flatpak runtime and an application against it.

If that all works, we should be ready to add koji-flatpak-hub and koji-flatpak-builder to the production koji instance.


Metadata Update from @zlopez:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: high-gain, high-trouble, ops

2 years ago

The F38 builds of flatpak-module-tools and koji-flatpak now exist, updated the list to reflect that.

I assume there are deadlines here? :)

I can run a koji prod->stg sync today. It takes... a long long time to sync. ;)

I assume there are deadlines here? :)

I'd certainly love to have this tested on stage and deployed on production before the Beta infrastructure freeze on 8-22. If we can't do that, then we'd likely need to slip FlatpaksWithoutModules for a release, which would delay retiring MBS and OSBS for a release, and I don't think anybody wants that.

I can run a koji prod->stg sync today. It takes... a long long time to sync. ;)

Thank you!

I'll try to create an ansible PR for the config changes.

I just noticed that I need to reinstall db-koji01.stg.... its rhel8, but I moved prod to rhel9/newer postgres. ;)

I'll try and get that soonish...

https://pagure.io/fedora-infra/ansible/pull-request/1536 - almost certainly isn't correct, but hopefully goes in the right direction.

I reinstalled db-koji01.stg yesterday and ran the sync. It should be back up and synced now... let me know if you see any problems with it.

After @kevin fixed a few repo generation issues, it all looks good, and I was successfully build Flatpaks against staging. AFAIK, everything is set to proceed onto deploying the plugin.

ok, next step is merge/deploy the infra ansible pr and test?

ok, next step is merge/deploy the infra ansible pr and test?

Yep!

ok. I tagged those two f38 packages info f38-infra-candidate (which has them signed and moved into f38-infra-stg and a distrepo made with tag2distrepo).

I merged the PR and ran the hub and builders playbook in staging. ;)

Test away.

Successful runtime build:
https://koji.stg.fedoraproject.org/koji/buildinfo?buildID=2273171

Successful application build:
https://koji.stg.fedoraproject.org/koji/buildinfo?buildID=2273172

I consider testing complete at this point. Will file a new issue for deployment to prod when I get a chance.

Sure, or we could just keep this one...

Should hopefully just be moving those builds to f38-infra and then a PR to adjust staging conditionals...

Sure, or we could just keep this one...

Should hopefully just be moving those builds to f38-infra and then a PR to adjust staging conditionals...

Yeah, we can do that. :-) https://pagure.io/fedora-infra/ansible/pull-request/1543

I've moved the builds, merged the pr and run the playbooks. ;)

Hopefully it's all set...

Metadata Update from @mizdebsk:
- Issue tagged with: koji

2 years ago

I think this is all done. Please re-open or file a new ticket if there's further to do here.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

2 years ago

Log in to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog