#9284 openh264 new repo dir format
Closed: Fixed by mohanboddu. Opened by mohanboddu.

Describe what you would like us to do:


We now changed how we create the openh264 repos using ODCS/pungi. But that means we have a newer directory structure which needs to be fixed.

Here are the changes on sundries01.iad2.fedoraproject.org on /srv/web/codecs.fedoraproject.org/openh264/<fedora_release_number>

  1. No more armhfp repo, its now in armv7hl
  2. i386 is replaced by i686
  3. No more ppc64 dir
  4. repodata is now part of os/ dir, for ex: /srv/web/codecs.fedoraproject.org/openh264/33/x86_64/os/
  5. debug repodata is now part of tree/ dir, for ex: /srv/web/codecs.fedoraproject.org/openh264/33/x86_64/debug/tree/

Pinging @adrian as we need to fix them in mirrormanager for this change.

When do you need this to be done by? (YYYY/MM/DD)

ASAP

Thanks.


Metadata Update from @mobrien:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: high-gain, medium-trouble

Synced the content to /srv/codecs.fp.o/openh264 on mm-backend01.iad2.fp.o

mm likely is confused now, I am seeing 404 errors on f34/rawhide h264 repo.

Now we need https://pagure.io/fedora-infra/ansible/pull-request/230 merged. I am currently running umdl manually to get the repositories detected.

So for 34 it is now pointing to the right location with os.

It sounds like you also want the old repositories to point to the locations with os. Can you update the tree on mm-backend01 so that it only contains the new location? The directory structure on the proxies still needs to contain both locations, but for MM to change the existing repositories I need a tree with only the new directory structure. I can then tell MM to re-detect the repositories and then it would point to the new locations on the proxies and only then can you clean up the tree on the proxies to only contain the new layout.

I am also not sure MM can handle i686 as an architecture name for i386. Did we use i686 somewhere else before? Is this name change necessary? The RPMs can be i686.rpm, but the directory name should stay i386.

The tree structure for new compose is:

32/
├── aarch64
   ├── debug
      └── tree
          ├── Packages
             ├── g
                └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.aarch64.rpm
             ├── m
                └── mozilla-openh264-debuginfo-2.1.1-1.fc32.aarch64.rpm
             └── o
                 ├── openh264-debuginfo-2.1.1-1.fc32.aarch64.rpm
                 └── openh264-debugsource-2.1.1-1.fc32.aarch64.rpm
          └── repodata
              ├── 3e4b46f62fcf2d68de892d0628be266de2d93d8adfd47535a5c5d2912fe597fa-primary.xml.gz
              ├── 8aafe93ff9a80f152f874ac83317bf02b1f02830902572069b46aa1a1b90b952-other.xml.gz
              ├── f3191d8b1c1610efde2a842c4fd654847260255527b0d603c85bcb49f41f898e-filelists.xml.gz
              ├── repomd.xml
              └── repomd.xml.asc
   └── os
       ├── media.repo
       ├── Packages
          ├── g
             └── gstreamer1-plugin-openh264-1.16.2-2.fc32.aarch64.rpm
          ├── m
             └── mozilla-openh264-2.1.1-1.fc32.aarch64.rpm
          └── o
              ├── openh264-2.1.1-1.fc32.aarch64.rpm
              └── openh264-devel-2.1.1-1.fc32.aarch64.rpm
       └── repodata
           ├── 1d1350a4ef7aadf4d41c641e851dfac04913fda4c381292c8fb928f6f23868cb-other.xml.gz
           ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.aarch64.xml
           ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.aarch64.xml.gz
           ├── 95d5096bf50d8355bbf7bcd6c4c8361ba253264207edb976c2902292a081a748-primary.xml.gz
           ├── e8cce9100d545f66a8ee4fc70db6967e629a7388fe41460db9e7785a333579da-filelists.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
├── armv7hl
   ├── debug
      └── tree
          ├── Packages
             ├── g
                └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.armv7hl.rpm
             ├── m
                └── mozilla-openh264-debuginfo-2.1.1-1.fc32.armv7hl.rpm
             └── o
                 ├── openh264-debuginfo-2.1.1-1.fc32.armv7hl.rpm
                 └── openh264-debugsource-2.1.1-1.fc32.armv7hl.rpm
          └── repodata
              ├── 96c454f2aa6abb757f58be68bae26c5662a1c0da7273311b88fc9e664ca48866-other.xml.gz
              ├── c55565e45a54adee5e2b1f48e4b485cd1a9da6a35859fc3b0f55304f9f3e59cb-filelists.xml.gz
              ├── ca8b4829b47ddd244a8594fcaad4ee0dfcc984bfc8ba383ba291455dd6dc171b-primary.xml.gz
              ├── repomd.xml
              └── repomd.xml.asc
   └── os
       ├── media.repo
       ├── Packages
          ├── g
             └── gstreamer1-plugin-openh264-1.16.2-2.fc32.armv7hl.rpm
          ├── m
             └── mozilla-openh264-2.1.1-1.fc32.armv7hl.rpm
          └── o
              ├── openh264-2.1.1-1.fc32.armv7hl.rpm
              └── openh264-devel-2.1.1-1.fc32.armv7hl.rpm
       └── repodata
           ├── 23409eba3af693aef50e9ea97f0bced18a0fa9cf116e600a25c88f206b2d5eea-filelists.xml.gz
           ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.armv7hl.xml
           ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.armv7hl.xml.gz
           ├── 5064de273622e00b384dbf9b3d66debb1e8954787fa4d9a322c06b69d773026c-primary.xml.gz
           ├── 88d42d964d69f193de8bb56dd2b733b07d4771e7e08959300624723bf92e381b-other.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
├── i686
   ├── debug
      └── tree
          ├── Packages
             ├── g
                └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.i686.rpm
             ├── m
                └── mozilla-openh264-debuginfo-2.1.1-1.fc32.i686.rpm
             └── o
                 ├── openh264-debuginfo-2.1.1-1.fc32.i686.rpm
                 └── openh264-debugsource-2.1.1-1.fc32.i686.rpm
          └── repodata
              ├── 42b37b17b7449c8588c7b67f6231feebf8953705832cf45c705d3798c933afac-filelists.xml.gz
              ├── 73b00c3dea897e2382c38cc401c7816f736a05c5c6b181f5540e2769c3d51389-other.xml.gz
              ├── e141140f4fd6547407136dd58e737b21aa380cdd5d5f20bee30f4446851b4dfe-primary.xml.gz
              ├── repomd.xml
              └── repomd.xml.asc
   └── os
       ├── media.repo
       ├── Packages
          ├── g
             └── gstreamer1-plugin-openh264-1.16.2-2.fc32.i686.rpm
          ├── m
             └── mozilla-openh264-2.1.1-1.fc32.i686.rpm
          └── o
              ├── openh264-2.1.1-1.fc32.i686.rpm
              └── openh264-devel-2.1.1-1.fc32.i686.rpm
       └── repodata
           ├── 2a514e154eb22a2880619acd9b7b684b0377d92e0c063a6ce5a45bdacbacc8ad-primary.xml.gz
           ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.i686.xml
           ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.i686.xml.gz
           ├── d26a90a37a9fa16f8effcd78e4fc7f86bb0e59442747f50d017d8eedcb6edbd3-other.xml.gz
           ├── e9cf559cbf53d6bec7c9892bf38272341aece0045e8ec9803072212d89ec676d-filelists.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
├── odcs-4214.repo
├── ppc64le
   ├── debug
      └── tree
          ├── Packages
             ├── g
                └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.ppc64le.rpm
             ├── m
                └── mozilla-openh264-debuginfo-2.1.1-1.fc32.ppc64le.rpm
             └── o
                 ├── openh264-debuginfo-2.1.1-1.fc32.ppc64le.rpm
                 └── openh264-debugsource-2.1.1-1.fc32.ppc64le.rpm
          └── repodata
              ├── 0cf140d17536ace29dcd7e6399ad76a677b15b9fb77f73c680687d098d065a41-other.xml.gz
              ├── 4ae51affc2c8932d67598a5e257773b4a59e62e578b99764a84149adb33807a8-filelists.xml.gz
              ├── 53ff980eeae7ace839731a1b4fd2ac065e00ac49391d1f3543d1a052d7fa1662-primary.xml.gz
              ├── repomd.xml
              └── repomd.xml.asc
   └── os
       ├── media.repo
       ├── Packages
          ├── g
             └── gstreamer1-plugin-openh264-1.16.2-2.fc32.ppc64le.rpm
          ├── m
             └── mozilla-openh264-2.1.1-1.fc32.ppc64le.rpm
          └── o
              ├── openh264-2.1.1-1.fc32.ppc64le.rpm
              └── openh264-devel-2.1.1-1.fc32.ppc64le.rpm
       └── repodata
           ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.ppc64le.xml
           ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.ppc64le.xml.gz
           ├── 66295594127b25096ba8c386d4232b70e254411416224f7587e496f44acd8e06-primary.xml.gz
           ├── ba9bd4509c8ee3d0a2a52a957c834eb7a617336219c27b328a2b988c609555be-filelists.xml.gz
           ├── ff6cde8e398bc95b23f69f395469981e2c259299f69319dd4c2a2c5f5cb42145-other.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
├── s390x
   ├── debug
      └── tree
          ├── Packages
             ├── g
                └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.s390x.rpm
             ├── m
                └── mozilla-openh264-debuginfo-2.1.1-1.fc32.s390x.rpm
             └── o
                 ├── openh264-debuginfo-2.1.1-1.fc32.s390x.rpm
                 └── openh264-debugsource-2.1.1-1.fc32.s390x.rpm
          └── repodata
              ├── 13ea222539cb22f6021c5e31ea958f07a090ef9a6cf0bbe921fdd3eda60c70f3-primary.xml.gz
              ├── 19e6bf90ece5548356337241273e6ca74314e42f72b8dbaa7e1097a3c0eca295-filelists.xml.gz
              ├── 896defddb64351a38fb50de3fb470be35f961f19083fdb5bca58b3806099bee5-other.xml.gz
              ├── repomd.xml
              └── repomd.xml.asc
   └── os
       ├── media.repo
       ├── Packages
          ├── g
             └── gstreamer1-plugin-openh264-1.16.2-2.fc32.s390x.rpm
          ├── m
             └── mozilla-openh264-2.1.1-1.fc32.s390x.rpm
          └── o
              ├── openh264-2.1.1-1.fc32.s390x.rpm
              └── openh264-devel-2.1.1-1.fc32.s390x.rpm
       └── repodata
           ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.s390x.xml
           ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.s390x.xml.gz
           ├── 75f5aea0225bd6b657b6fde6abb14e0a55bbb9b16ebd6650c80e3d2202ac8456-other.xml.gz
           ├── 9204fa7dc7dfbd66a479b7928736167da799e9d1f1422cceacab10df64cd82b1-filelists.xml.gz
           ├── b1336b1c464e60e773b4a0004341ab8aed6be4b99c48e745f3c60700ddb774c6-primary.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
├── source
   └── tree
       ├── media.repo
       ├── Packages
          └── o
              └── openh264-2.1.1-1.fc32.src.rpm
       └── repodata
           ├── 4e2dae3c932e35cea5d18054b2a8387f79eca2947f792a929a9d77258275a1bb-other.xml.gz
           ├── 67b8dc451d9078502d09f9ab5e44bc276aa56876818cc4c236100835065e1c38-primary.xml.gz
           ├── ae59d93de91a42b0da82e4bd02d3508e79a77e948f7f68cab9240cec5ca79996-filelists.xml.gz
           ├── repomd.xml
           └── repomd.xml.asc
└── x86_64
    ├── debug
       └── tree
           ├── Packages
              ├── g
                 └── gstreamer1-plugin-openh264-debuginfo-1.16.2-2.fc32.x86_64.rpm
              ├── m
                 └── mozilla-openh264-debuginfo-2.1.1-1.fc32.x86_64.rpm
              └── o
                  ├── openh264-debuginfo-2.1.1-1.fc32.x86_64.rpm
                  └── openh264-debugsource-2.1.1-1.fc32.x86_64.rpm
           └── repodata
               ├── a05bc98b4ae72f4b6e908a5791da7963ebd9e6e4571f5c8bb30b470fa287ad51-other.xml.gz
               ├── cd5e0aa3087d83526e807c595f72494657364677d17abc69869245e73ef290d4-primary.xml.gz
               ├── e9c9b21f4798a0f4916e3ec628c7249f546045911d0bbeae83f0f12c30531efc-filelists.xml.gz
               ├── repomd.xml
               └── repomd.xml.asc
    └── os
        ├── media.repo
        ├── Packages
           ├── g
              └── gstreamer1-plugin-openh264-1.16.2-2.fc32.x86_64.rpm
           ├── m
              └── mozilla-openh264-2.1.1-1.fc32.x86_64.rpm
           └── o
               ├── openh264-2.1.1-1.fc32.x86_64.rpm
               └── openh264-devel-2.1.1-1.fc32.x86_64.rpm
        └── repodata
            ├── 2b13cd3f9d81647fd31aa16de1b16b582efd9566f8c4334e4561a030f3777c37-comps-Temporary.x86_64.xml
            ├── 3d50825fb25440abc9579f078205d6ba3590b1d146187af8179eb43214c8b40e-comps-Temporary.x86_64.xml.gz
            ├── 6f16cc8c75e43b9bd9bcc68555d162cfdcb67f199bf2cdf6e0d86a9a164ca56f-primary.xml.gz
            ├── 887b34f0472484e6472be8d64c7fa56fc78f51772b509dea8124d6f912343aec-other.xml.gz
            ├── beb2373081447167e25565e39c4c9c63306f9657acbf28680bba0300bc4e5a97-filelists.xml.gz
            ├── repomd.xml
            └── repomd.xml.asc

Moved armv7hl to armhfp and i686 to i386 on both mm-backend01 and sundries01

On sundries01:

[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/32/armhfp /srv/web/codecs.fedoraproject.org/openh264/32/armhfp.old
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/33/armhfp /srv/web/codecs.fedoraproject.org/openh264/33/armhfp.old
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/34/armhfp /srv/web/codecs.fedoraproject.org/openh264/34/armhfp.old
mv: cannot stat /srv/web/codecs.fedoraproject.org/openh264/34/armhfp’: No such file or directory
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/34/armv7hl /srv/web/codecs.fedoraproject.org/openh264/34/armhfp
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/33/armv7hl /srv/web/codecs.fedoraproject.org/openh264/33/armhfp
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/32/armv7hl /srv/web/codecs.fedoraproject.org/openh264/32/armhfp
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/32/i386 /srv/web/codecs.fedoraproject.org/openh264/32/i386.old
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/33/i386 /srv/web/codecs.fedoraproject.org/openh264/33/i386.old
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/34/i386 /srv/web/codecs.fedoraproject.org/openh264/34/i386.old
mv: cannot stat /srv/web/codecs.fedoraproject.org/openh264/34/i386’: No such file or directory
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/34/i686 /srv/web/codecs.fedoraproject.org/openh264/34/i386
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/33/i686 /srv/web/codecs.fedoraproject.org/openh264/33/i386
[mohanboddu@sundries01 ~][PROD-IAD2]$ mv /srv/web/codecs.fedoraproject.org/openh264/32/i686 /srv/web/codecs.fedoraproject.org/openh264/32/i386

On mm-backend01:

[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/32/armhfp /srv/codecs.fedoraproject.org/openh264/32/armhfp.old
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/33/armhfp /srv/codecs.fedoraproject.org/openh264/33/armhfp.old
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/34/armhfp /srv/codecs.fedoraproject.org/openh264/34/armhfp.old
mv: cannot stat /srv/codecs.fedoraproject.org/openh264/34/armhfp’: No such file or directory
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/34/armv7hl /srv/codecs.fedoraproject.org/openh264/34/armhfp
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/33/armv7hl /srv/codecs.fedoraproject.org/openh264/33/armhfp
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/32/armv7hl /srv/codecs.fedoraproject.org/openh264/32/armhfp
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/32/i386 /srv/codecs.fedoraproject.org/openh264/32/i386.old
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/33/i386 /srv/codecs.fedoraproject.org/openh264/33/i386.old
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/34/i386 /srv/codecs.fedoraproject.org/openh264/34/i386.old
mv: cannot stat /srv/codecs.fedoraproject.org/openh264/34/i386’: No such file or directory
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/34/i686 /srv/codecs.fedoraproject.org/openh264/34/i386
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/33/i686 /srv/codecs.fedoraproject.org/openh264/33/i386
[mohanboddu@mm-backend01 ~][PROD-IAD2]$ mv /srv/codecs.fedoraproject.org/openh264/32/i686 /srv/codecs.fedoraproject.org/openh264/32/i386

I still have a tree with arch/repodata and arch/os/repodata on mm-backend01. Can you sync the correct tree to mm-backend01? MM will have problems doing the right thing as long as there are repodata directories at multiple locations.

Cleaning up the directories:

$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/armhfp.old/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/armhfp.old/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/i386.old/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/i386.old/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/ppc64/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/ppc64/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/g
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/g
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/m
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/m
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/o
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/o
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/repodata/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/repodata/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/debug/g
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/debug/g
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/debug/m
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/debug/m
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/debug/o
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/debug/o
$ rm -rv /srv/codecs.fedoraproject.org/openh264/32/*/debug/repodata/
$ rm -rv /srv/codecs.fedoraproject.org/openh264/33/*/debug/repodata/

@adrian Now f32 and f33 should have the same tree structure as that of f34, so it should work.

Just wondering, do I need to do the same thing on sundries01? Which is syncing to proxies?

Now F32, F33 and F34 are pointing to the new tree with os/. Please verify to make sure. Works on my side. Once you are sure it works for all releases you can delete the old directory structure on the master (from what I understand this might be sundries01???) and sync it to all the proxies.

This work is done.

Metadata Update from @mohanboddu:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

Metadata