I did this dumb draft a while back. We want to add something like this for real. We should cover systems we have access to which are used by a lot of folks, and especially ones which come preloaded with Fedora and/or have support from the vendor - like Framework, Slimbook, some Lenovo models.
We should also have a table for ARM hardware to try and make sure we actually do the ARM hardware testing at Beta. It should list at least Raspberry Pi (3 and 4), and any other ARM platforms we think are sufficiently testable and real-world interesting to merit planned hardware testing.
CC @pbrobinson @pwhalen @coremodule @lbrabec @ctsdownloads ... @mpearson er...anyone know someone at slimbook to CC?
I will do the work on this, just wanted folks in the loop, and to suggest specific models and things it would be good to test.
Thanks Adam - this is very cool.
For things to test: We have different test suites depending on what is being done. We should probably discuss offline but I can almost certainly share what we do for our 'quick sanity' testing. This is a set of (still manual at this point sadly) tests that we run thru with a platform/OS combo to check that all the basics are sane. I'll review and send to you, but nag me if I forget.
We then have a much fuller test suite that QA run thru for the preload images. It's more detailed and takes much longer to run. I suspect it's overkill (and I also suspect I probably can't share it publicly)
However - if you have this table it might be interesting to combine with what we do, so QA can maybe fill in the table as they test Fedora (I'd have to confirm with them if it's possible once you have more details filled in - there will be the usual resource availability questions...I hate that phrase....)
If you have any plans for automating this....let me know. That would be interesting :)
For platforms - want me to just add the Fedora preloaded systems to the table? You should have all of those in the RH lab and I'm sure we can get involved and help out as needed. Of course we have all the Linux certified platforms as a wider scope - but getting to access to all those (about 20 to 30 platforms a years might be challenging and harder to add - though they should pass all the tests except anything involving Nvidia or WWAN)
Mark
automating would be nice but is probably a ways down the road (my pikvm is, uh, still sitting in its box :<). for now this is going to be manual testing.
it'd be great if you could share your 'quick sanity' tests, that's probably the level we want for this.
if you give me a list of the fedora preloaded systems, I can include it in the table (probably best for me to do it as all this matrix stuff is tied into the wikitcms templates and python-wikitcms and stuff).
Login to comment on this ticket.