In order to perform FCOS release validation, or to host FCOS test days, we'll need test cases. Do we already have some, @sumantrom ? Either way, we'll probably need more, at least for the basics. Some inspiration can be taken from proposed Silverblue test cases. Another inspiration can be taken from FCOS Hand-On Lab.
@coremodule @sumantrom Any volunteers? Can each of you draft up 1-2 test cases perhaps? Once we have a draft, we can then consult it with FCOS team. Or we can even ask them right away if they have some test cases or are willing to create something with us together.
Metadata Update from @kparal: - Issue tagged with: test cases
Metadata Update from @sumantrom: - Issue assigned to sumantrom
We can reuse: https://fedoraproject.org/wiki/QA:Testcase_base_services_start?rd=QA:Testcase_Services_start https://fedoraproject.org/wiki/QA:Testcase_base_selinux https://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation
I am setting up the FCOS and writing the Test cases now. This will be done by this week.
In #616 we'll try to come up with some test cases targeting the test day. They will not be universally usable for release validation, but they can be taken as a basis for them. So this ticket is probably suspended for a while, at least until #616 is over.
Metadata Update from @sumantrom: - Custom field blockedby adjusted to #616
While developing test-cases for CoreOS, @kparal, @sumantrom, and myself discovered that the documentation around logging into a CoreOS machine without an Ignition setup was not well documented. This bug [0] has been opened on the official CoreOS github page to add the necessary documentation.
[0] https://github.com/coreos/fedora-coreos-docs/issues/79
@kparal Can/should we use this same tracker for FCOS Test Cases in F33?
We have a decent number of testcases from the last testday in #616: https://fedoraproject.org/wiki/Category:CoreOS_Test_Cases
Do you think we should keep this ticket open to create some more testcases, or that we have enough for now? Or perhaps I'm misunderstanding your question.
We have a decent number of testcases from the last testday in #616: https://fedoraproject.org/wiki/Category:CoreOS_Test_Cases Do you think we should keep this ticket open to create some more testcases, or that we have enough for now? Or perhaps I'm misunderstanding your question.
Yes, I meant to ask, if a) do we really need this ticket? since the purpose is solved, we can close this ticket. b) however, if we keep this ticket open, can we bump the milestone to F33 instead of F32. Since any progress post this about adding test cases will be for F33 release and not for F33?
I think we have sufficient number of testcases now, so let's close this ticket.
Metadata Update from @kparal: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.