Plan F45 test days (Changes, usual events) #916

Open
opened 2026-07-20 15:56:16 +00:00 by kparal · 7 comments
Owner

As discussed in our 2026-07-20 Quality meeting, we want to cover important F45 Changes as test days. And we also want to plan the usual test days as well. This is the top-level planning ticket.

See the ticket dependencies for individual tickets to handle particular test days.

Please take some and help us organize them.


Other ideas, not yet turned to tickets:

If you think some of those (or others) should receive a ticket, speak up (or DIY).

As discussed in our [2026-07-20 Quality meeting](https://meetbot-raw.fedoraproject.org//meeting_matrix_fedoraproject-org/2026-07-20/quality.2026-07-20-15.05.log.html), we want to cover important [F45 Changes](https://fedoraproject.org/wiki/Releases/45/ChangeSet) as test days. And we also want to plan the usual test days as well. This is the top-level planning ticket. **See the ticket dependencies for individual tickets to handle particular test days.** Please **take some** and help us organize them. ---- Other ideas, not yet turned to tickets: * https://fedoraproject.org/wiki/Changes/UseKmsconVTConsole - this one landed already, but could benefit from wider testing * ~~https://fedoraproject.org/wiki/Changes/Podman6 - this is related to our Toolbx criterion/test case~~ -- see the comment below * https://fedoraproject.org/wiki/Changes/OpenSSL40 - this could affect lots of things, but I'm not sure how to test it and whether to do a specific test day for it * https://fedoraproject.org/wiki/Changes/Anaconda_WebUI_Fedora_Atomic (not yet accepted) - might be a part of #918 or standalone * CoreOS * Kernel 7.2 If you think some of those (or others) should receive a ticket, speak up (or DIY).
kparal added this to the Fedora 45 milestone 2026-07-20 15:56:16 +00:00

FWIW there was already a podman 6 test day https://fedoraproject.org/wiki/Test_Day:2026-05-11_Podman_6.0

It was a bit early before the proper final release so it might make sense to have another closer to fedora 45 beta/final.

That said as more general note from an upstream maintainer I do not think we have been utilizing the test days for much useful things. The test cases, i.e. https://testdays.fedoraproject.org/testday/21, are mostly stuff our automated test suites already cover. Since podman has even openQA testing the chance of major problems going into the stable repos is even lower. Of course a sanity check from users is not wrong but it means the feedback we get from these in terms of useful bug reports is very low.
I guess it is more of a task for us podman maintainers to write test cases our automation cannot check for where the extra people doing the test cases would actually be able to uncover real problems.

FWIW there was already a podman 6 test day https://fedoraproject.org/wiki/Test_Day:2026-05-11_Podman_6.0 It was a bit early before the proper final release so it might make sense to have another closer to fedora 45 beta/final. That said as more general note from an upstream maintainer I do not think we have been utilizing the test days for much useful things. The test cases, i.e. https://testdays.fedoraproject.org/testday/21, are mostly stuff our automated test suites already cover. Since podman has even openQA testing the chance of major problems going into the stable repos is even lower. Of course a sanity check from users is not wrong but it means the feedback we get from these in terms of useful bug reports is very low. I guess it is more of a task for us podman maintainers to write test cases our automation cannot check for where the extra people doing the test cases would actually be able to uncover real problems.
Author
Owner

Thanks Paul, I completely forgot about the recent Podman test day. Yeah, with test days it's good to come up with tests that leverage userbase benefits (e.g. various hardware, different configurations, unexpected workflows) rather than mirror the automated test suite. At the same time, some of those need experienced users who use the tool regularly, rather than a newcomer wanting to help. But let's try to think about this and improve it in the future.

Thanks Paul, I completely forgot about the recent Podman test day. Yeah, with test days it's good to come up with tests that leverage userbase benefits (e.g. various hardware, different configurations, unexpected workflows) rather than mirror the automated test suite. At the same time, some of those need experienced users who use the tool regularly, rather than a newcomer wanting to help. But let's try to think about this and improve it in the future.
kparal changed title from Turn Fedora 45 Changes to Test days to Plan F45 test days (Changes, usual events) 2026-07-22 11:26:04 +00:00
Owner

Note for test cases: one way we can collaborate is you can just give us the skeleton of such a test - just as a bullet point list, or whatever - and we can do the work of turning it into a proper wiki test case and integrating it into the test day table...

Note for test cases: one way we can collaborate is you can just give us the skeleton of such a test - just as a bullet point list, or whatever - and we can do the work of turning it into a proper wiki test case and integrating it into the test day table...
Author
Owner

@pnemade Will you want to have i18n test days for Fedora 45?

@ydesouza @hricky Will you want to have CoreOS test days for Fedora 45?

@pnemade Will you want to have i18n test days for Fedora 45? @ydesouza @hricky Will you want to have CoreOS test days for Fedora 45?

@kparal wrote in #916 (comment):

@pnemade Will you want to have i18n test days for Fedora 45?

Yes. Will create test week wiki page by next week Tuesday.

@kparal wrote in https://forge.fedoraproject.org/quality/tickets/issues/916#issuecomment-1072055: > @pnemade Will you want to have i18n test days for Fedora 45? > Yes. Will create test week wiki page by next week Tuesday.
Author
Owner

@pnemade Great. Let's talk about the details in #924 . Thanks!

@pnemade Great. Let's talk about the details in #924 . Thanks!

@kparal wrote in #916 (comment):

@ydesouza @hricky Will you want to have CoreOS test days for Fedora 45?

Yes, we have tentatively scheduled the F45 Fedora CoreOS Test Week for 2026-09-21. The target date depends on the beta release schedule and may be adjusted if necessary. See Tracker: F45 Test Week. Should we also open the ticket for the F45 Fedora CoreOS Test Week in this repo?

@kparal wrote in https://forge.fedoraproject.org/quality/tickets/issues/916#issuecomment-1072055: > @ydesouza @hricky Will you want to have CoreOS test days for Fedora 45? Yes, we have tentatively scheduled the F45 Fedora CoreOS Test Week for 2026-09-21. The target date depends on the beta release schedule and may be adjusted if necessary. See [Tracker: F45 Test Week](https://github.com/coreos/fedora-coreos-tracker/issues/2204). Should we also open the ticket for the F45 Fedora CoreOS Test Week in this repo?
Sign in to join this conversation.
No milestone
No project
No assignees
5 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
quality/tickets#916
No description provided.