dusty / failed-composes

#451 Fedora-Rawhide-20180612.n.0 DOOMED
Opened by dustymabe. Modified

Open
Close Issue

pungi.global.log

[INFO    ] [FAIL] Ostree (variant AtomicWorkstation, arch x86_64) failed, but going on anyway.
[INFO    ] Runroot task failed: 27570645. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/x86_64/AtomicWorkstation/ostree-4/runroot.log for more details.

[LIVE_MEDIA      ] [INFO    ] [FAIL] Live media (variant Labs, arch *, subvariant Astronomy_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] Live media task failed: 27571720. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/i386-x86_64/livemedia-Labs-Astronomy_KDE.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [INFO    ] [FAIL] Live media (variant Labs, arch *, subvariant Games) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] Live media task failed: 27571751. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/i386-x86_64/livemedia-Labs-Games.i386-x86_64.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Server, arch armhfp, subvariant Server) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571710. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-Server-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Spins, arch armhfp, subvariant SoaS) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571753. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-SoaS-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.
  • No Task ID, look at log statement
[INFO    ] [FAIL] Live media (variant Spins, arch x86_64, subvariant Cinnamon) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Cinnamon-Live/Rawhide/20180612.n.0/images/Fedora-Cinnamon-Live-i386-Rawhide-20180612.n.0.iso to /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/compose/Spins/i386/iso/Fedora-Cinnamon-Live-i386-Rawhide-20180612.n.0.iso

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Labs, arch armhfp, subvariant Python_Classroom) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571707. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-Python-Classroom-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Spins, arch armhfp, subvariant LXDE) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571723. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-LXDE-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Spins, arch armhfp, subvariant LXQt) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571776. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-LXQt-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Spins, arch armhfp, subvariant Mate) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571737. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-Mate-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Workstation, arch armhfp, subvariant Workstation) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571784. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-Workstation-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [INFO    ] [FAIL] Live (variant Spins, arch armhfp, subvariant KDE) failed, but going on anyway.
[LIVE_IMAGES     ] [INFO    ] LiveImage task failed: 27571714. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-KDE-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Cloud, arch *, subvariant Cloud_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 27571742. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/x86_64/imagebuild-Cloud-Cloud_Base-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.
  • No Task ID, look at log statement
[INFO    ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Base) failed, but going on anyway.
[INFO    ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[INFO    ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Base/Rawhide/20180612.n.0/images/Fedora-Container-Base-Rawhide-20180612.n.0.aarch64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/compose/Container/aarch64/images/Fedora-Container-Base-Rawhide-20180612.n.0.aarch64.tar.xz
  • No Task ID, look at log statement
[INFO    ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Minimal_Base) failed, but going on anyway.
[INFO    ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[INFO    ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Minimal-Base/Rawhide/20180612.n.0/images/Fedora-Container-Minimal-Base-Rawhide-20180612.n.0.aarch64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/compose/Container/aarch64/images/Fedora-Container-Minimal-Base-Rawhide-20180612.n.0.aarch64.tar.xz
  • Compose run failed because: - 27571750
[ERROR   ] Compose run failed: LiveImage task failed: 27571750. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180612.n.0/logs/armhfp/liveimage-Fedora-Minimal-armhfp-Rawhide-20180612.n.0.armhfp.log for more details.

I have no idea what the issue is.

@kevin probably refire?

Yeah, I am puzzled too. I guess we re-run or wait for tomorrow...

I am facing the same issues on Fedora/RISC-V koji for the last 2-3 days, before it worked just fine. I did some debugging. This is what I see:

Unmounting directory /var/tmp/imgcreate-zGfNxc/install_root/
umount: /var/tmp/imgcreate-zGfNxc/install_root/: target is busy.
NAME        SIZELIMIT OFFSET AUTOCLEAR RO BACK-FILE                                                                          DIO LOG-SEC
/dev/loop1          0      0         0  0 /var/tmp/imgcreate-bYLpjE/tmp-ylbBvC/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop11         0      0         0  0 /var/tmp/imgcreate-VrqzLM/tmp-Xol4A5/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop8          0      0         0  0 /var/tmp/imgcreate-Yxtui0/tmp-pvfWj5/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop6          0      0         0  0 /var/tmp/imgcreate-GwUCN4/tmp-Ry3iQy/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop4          0      0         0  0 /var/tmp/imgcreate-MW0GOt/tmp-u_huvk/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop2          0      0         0  0 /var/tmp/imgcreate-aYGoRo/tmp-9k1F5f/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop0          0      0         0  0 /var/tmp/imgcreate-oVthgu/tmp-zO5orq/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop12         0      0         0  0 /var/tmp/imgcreate-zGfNxc/tmp-jS6CNX/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop9          0      0         0  0 /var/tmp/imgcreate-uyrB8S/tmp-QYdmWq/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop10         0      0         0  0 /var/tmp/imgcreate-4OcRgI/tmp-Kspqcc/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop7          0      0         0  0 /var/tmp/imgcreate-pPZDfb/tmp-Z4ccEd/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop5          0      0         0  0 /var/tmp/imgcreate-rHnJyh/tmp-9WS7e9/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
/dev/loop3          0      0         0  0 /var/tmp/imgcreate-cOIcHZ/tmp-4Hcjza/Fedora-Developer-Rawhide-20180616.n.0-sda.raw   0     512
                     USER        PID ACCESS COMMAND
/var/tmp/imgcreate-zGfNxc/install_root:
                     root     kernel mount /var/tmp/imgcreate-zGfNxc/install_root
                     root       1726 ....m appliance-creat
COMMAND    PID USER  FD   TYPE DEVICE SIZE/OFF NODE NAME
appliance 1726 root mem    REG 252,12   369344 7545 /var/tmp/imgcreate-zGfNxc/install_root/usr/lib64/libnss_systemd.so.2
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0 159120  6996 ?        Ss   05:40   0:14 /usr/lib/systemd/systemd --switched-root --system --deserialize 33
[..]
root      1726 74.9  1.3 138352 111140 pts/3   S+   12:44   4:11 /usr/bin/python2 -tt /usr/bin/appliance-creator -c ./fedora-riscv64-developer-rawhide.ks -d -v --logfile ./appliance.log --cache ./koji-appliance -o app-output --format raw --name Fedora-Developer-Rawhide-20180616.n.0 --version Rawhide --release 20180616.n.0

So appliance-creator has a file mapped from loop mount point. Thus you cannot umount it until the actual scripts finishes who is producing the disk image.
Edited by davidlt

Could someone check it on other failing arches that it's also libnss_systemd.so.2 still running from just constructed disk image?

We untagged sssd as a shot in the dark and it seems to have worked.

I filed: https://bugzilla.redhat.com/show_bug.cgi?id=1591804 on this issue.

Can you try it with sssd-1.16.1-9.fc29?

I looked in Fedora/RISC-V koji instance and yes, sssd was rebuilt 2 days ago. This looks to be a similar time when I started noticing this problem.

I will also untag it and see if it solves the problem.

I can confirm that untagging latest sssd build in Fedora/RISC-V solve disk image problem.
Metadata
None
None
None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.