DEBUG util.py:439:  subprocess.CalledProcessError: Command '['cp', '-a', '/var/tmp/lorax.7i0mc3y6/installtree/.', '/var/tmp/lorax.imgutils.0z5n_frz']' returned non-zero exit status 1.
DEBUG util.py:577:  Child return code was: 1

Looks like more lorax fun, but a different bug this time :( @bcl new lorax still breaking composes...

Looking at the program.log for the compose reveals a pile of:

No space left on device

errors. So it's likely that either things have grown too large for the default 2G rootfs, or something is pulling in more deps than expected and making it too large.

FWIW I have a rawhide VM setup here that I ran a compose on last night and it also installed 766 packages and worked fine, the rootfs has 344M free so it's not terribly close to the limit.

I'd look into whether or not the build host ran out of space.

What sources did you use for your test compose? If it's pulling from the public repos, those contain the bits from the last successful official compose...so if composing from those bits with newer lorax works, that would tend to indicate the problem really is in some package change between then and now, getting much bigger or pulling in extra dependencies...

Oh, man, I hope this isn't another case of debug symbol strippage fail like we had before...

I used:

http://dl.fedoraproject.org/pub/fedora/linux/development/rawhide/Everything/x86_64/os/

I used:
http://dl.fedoraproject.org/pub/fedora/linux/development/rawhide/Everything/x86_64/os/

could you try with https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-20180828.n.1/compose/Everything/x86_64/os/ ?

Never mind, we figured it out (or rather @kevin did): llvm-libs is huge again, likely due to debug symbols not being stripped from the library.

Fails with a full rootfs when I use kojipkgs.

/dev/loop0 2.0G 1.9G 0 100% /mnt/lo1

The ./installtree/ has 2.9G in it.

/usr/lib64 is pretty large, and the culprit appears to be:

-rwxr-xr-x. 2 root root 1430071416 Aug 28 11:41 libLLVM-7.so

Ha, whoops, figured it out in parallel :)