#1991 Fedora-29-updates-20190612.0 FINISHED_INCOMPLETE
Opened by dustymabe. Modified

pungi.global.log

[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant AtomicHost, arch *, subvariant AtomicHost) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 35493686. See /mnt/koji/compose/updates/Fedora-29-updates-20190612.0/logs/aarch64-ppc64le-x86_64/imagebuild-AtomicHost-AtomicHost-qcow2-raw-xz.aarch64-ppc64le-x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant AtomicHost, arch *, subvariant AtomicHost) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 35493692. See /mnt/koji/compose/updates/Fedora-29-updates-20190612.0/logs/x86_64/imagebuild-AtomicHost-AtomicHost-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.

Imagebuild would be failing due to koji, oz, imagefactory, createrepo_c, mock updates on builder . See https://pagure.io/dusty/failed-composes/issue/1997#comment-575743 .

Imagebuild from Fedora-29-updates-20190613.0 failed as well https://koji.fedoraproject.org/koji/taskinfo?taskID=35513111 .

Imagebuild would be failing due to koji, oz, imagefactory, createrepo_c, mock updates on builder . See https://pagure.io/dusty/failed-composes/issue/1997#comment-575743 .
Imagebuild from Fedora-29-updates-20190613.0 failed as well https://koji.fedoraproject.org/koji/taskinfo?taskID=35513111 .

Thanks sinny. Is that expected? Is someone working on fixing it ?

Imagebuild would be failing due to koji, oz, imagefactory, createrepo_c, mock updates on builder . See https://pagure.io/dusty/failed-composes/issue/1997#comment-575743 .
Imagebuild from Fedora-29-updates-20190613.0 failed as well https://koji.fedoraproject.org/koji/taskinfo?taskID=35513111 .

Thanks sinny. Is that expected? Is someone working on fixing it ?

Haven't looked much into it. I see @kevin is the latest who looked at it and something related to switch to Python3 version of oz, imagefactory, koji on builders

I was looking more into this failure. Pasting actual error message from build log:

Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/koji/daemon.py", line 1295, in runTask
    response = (handler.run(),)
  File "/usr/lib/python3.7/site-packages/koji/tasks.py", line 311, in run
    return koji.util.call_with_argcheck(self.handler, self.params, self.opts)
  File "/usr/lib/python3.7/site-packages/koji/util.py", line 263, in call_with_argcheck
    return func(*args, **kwargs)
  File "/usr/sbin/kojid", line 4172, in handler
    images = self.do_images(ks, template, inst_tree)
  File "/usr/sbin/kojid", line 3807, in do_images
    self.base_img = self._buildBase(template, params)
  File "/usr/sbin/kojid", line 3915, in _buildBase
    self._checkImageState(base)
  File "/usr/sbin/kojid", line 3863, in _checkImageState
    image.os_plugin.abort() # forcibly tear down the VM
AttributeError: 'NoneType' object has no attribute 'abort'

Reproducing same error locally is impractical because error message is from koji which I believe imports imagefactory module and calls various functions to build image. Locally, I reproduce imageactory related issue by running imagefactory Python script directly. With latest changes, one of the possible issue I see is imagefactory-plugins package has not been ported to Python3. More details at https://pagure.io/dusty/failed-composes/issue/1997#comment-576247

qcow2 imags are building fine now on all arches but vagrant images are failing. Error from log with koji task 35605249 -

Exception encountered in _customize_image_for_target thread
argument of type 'FileExistsError' is not iterable
Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/ovfcommon/ovfcommon.py", line 760, in sync
    os.makedirs(os.path.dirname(self.ovf_path))
  File "/usr/lib64/python3.7/os.py", line 221, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/var/tmp/koji/tasks/5249/35605249/output_image/tmp0cx57f1g'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/imgfac/Builder.py", line 241, in _customize_image_for_target
    self.cloud_plugin.builder_did_create_target_image(self, target, image_id, template, parameters)
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/OVA/OVA.py", line 77, in builder_did_create_target_image
    self.generate_ova()
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/OVA/OVA.py", line 136, in generate_ova
    ova = pkg.make_ova_package()
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/ovfcommon/ovfcommon.py", line 1274, in make_ova_package
    return super(VirtualBoxOVFPackage, self).make_ova_package(gzip=False)
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/ovfcommon/ovfcommon.py", line 793, in make_ova_package
    self.sync()
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/ovfcommon/ovfcommon.py", line 1253, in sync
    super(VirtualBoxOVFPackage, self).sync()
  File "/usr/lib/python3.7/site-packages/imagefactory_plugins/ovfcommon/ovfcommon.py", line 762, in sync
    if "File exists" not in e:
TypeError: argument of type 'FileExistsError' is not iterable
ABORT called in TinMan plugin

looks like the FileExistsError' is not iterable should be fixed upstream

I'm building a new imagefactory-plugins package with the fix.

Thanks @dustymabe and @kevin , I see vagrant image from compose Fedora-29-updates-20190620.1 went well

awesome!

Metadata