fedora-ci / general

#6 Ability to mark test xfail (expected failure)
Closed by mvadkert. Opened by churchyard.

Closed
Reopen Issue

I have a test, I know it's failing for now, yet I want to have it for future reference.

Can I mark the test xfail (expected failure)?

    tests:
    - smoke:
        dir: python/smoke
        run: ./venv.sh
        xfail: true

@astepano seems like something we could support in all our roles. @psss maybe something in the future for FMF?

@mvadkert, yeah, something like that could be useful in FMF as well.

For the fmf part, there is a new proposed attribute result which could be used to handle similar use case when fmf is used for selecting tests for execution:

  • https://pagure.io/fedora-ci/metadata/pull-request/2

@astepano @psss @mvadkert is this something we can do? Maybe we got lucky and we already have it? =)

This is not going to happen with STI and I believe with TMT it should:

https://tmt.readthedocs.io/en/latest/spec/tests.html#result

Unfortunately not yet implemented ....

@psss is this something working now with tmt?

I will close it, this is available for some time in tmt.

STI is not planned to be extended.
Consider https://tmt.readthedocs.io/en/latest/questions.html#how-do-i-migrate-sti-tests-to-tmt

Metadata Update from @mvadkert:
- Issue status updated to: Closed (was: Open)
Metadata
None
None
None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.