Feels the first one is more an extension to rpminspect ... which should be doing static analysis in these terms

The second one sounds interesting, so you would like to see a repository with arbitrary generic tests people like you could define and maintain?

cc @tflink

@mvadkert rpminspect tests are self-contained. If you extend it, then it can become "a CI service" instead of "a CI tool". That means, it would need to handle second case too.

The second one sounds interesting, so you would like to see a repository with arbitrary generic tests people like you could define and maintain?

Some kind of, but it is definitely more complicated than just "define tests.yml" because you need to create filtering on built RPMs and define complex pipeline with running bunch of scripts.

@mvadkert rpminspect tests are self-contained. If you extend it, then it can become "a CI
service" instead of "a CI tool". That means, it would need to handle second case too.

Yeah well, that seems a self contained test, I think original rpmdiff even had it, but I get you. Would be nice if these tests you could easily add according to your preference.

Some kind of, but it is definitely more complicated than just "define tests.yml" because you ?
need to create filtering on built RPMs and define complex pipeline with running bunch of
scripts.

Well, anything you can script :) the Ci system just needs to make easily available built RPMs to you I guess.

Yeah well, that seems a self contained test, I think original rpmdiff even had it, but I get you. Would be nice if these tests you could easily add according to your preference.

Well, desktop-file-validate, appstream-util validate, and bunch of other dependencies.

Well, anything you can script :) the Ci system just needs to make easily available built RPMs to you I guess.

No no no. I don't want to run tests myself. I want CI system to run these tests for ALL packages.