RFE: Add Test Management Tool info to the dashboard #161

New issue

Open

opened 2022-09-13 18:51:04 +00:00 by mattdm · 2 comments

mattdm commented

2022-09-13 18:51:04 +00:00

TMT is our (current) standard for storing CI tests for packages in a git repo. I think having tmt information on the packager dashboard would help increase packager awareness and increase coverage.

The low-hanging fruit is simply something like:

"This package has no tmt tests. You can add them easily."

Followed by more sophisticated things like:

⚠️ This package's tests have failed since 2022-09-13!

... and whatever else.

[TMT](https://docs.fedoraproject.org/en-US/ci/tmt/) is our (current) standard for storing CI tests for packages in a git repo. I think having tmt information on the packager dashboard would help increase packager awareness and increase coverage. The low-hanging fruit is simply something like: * "This package has no tmt tests. You can [add them easily](https://docs.fedoraproject.org/en-US/ci/tmt/)." Followed by more sophisticated things like: * ⚠️ This package's tests have failed since 2022-09-13! ... and whatever else.

churchyard commented

2022-09-13 18:56:35 +00:00

Contributor

This package has no tmt tests.

Considering only less than 2% of our components have tmt tests I am afraid this might be too noisy.

This package's tests have failed since 2022-09-13!

Where would we look for this kind of information? Doesn't necessarily have to be an API, I generally have no idea where I would look this up as human user either.

> This package has no tmt tests. Considering only [less than 2% of our components have tmt tests](https://lists.fedoraproject.org/archives/list/ci@lists.fedoraproject.org/thread/V66SQA3WJR3PTBM37QMCP2VYFV4H7S7R/) I am afraid this might be too noisy. > This package's tests have failed since 2022-09-13! Where would we look for this kind of information? Doesn't necessarily have to be an API, I generally have no idea where I would look this up as human user either.

mvadkert commented

2022-09-13 19:16:09 +00:00

Considering only less than 2% of our components have tmt tests I am afraid this might be too noisy.

Maybe a small icon with hover text would be better? Next to FTBFS and similar?

Where would we look for this kind of information? Doesn't necessarily have to be an API, I generally have no idea where I would look this up as human user either.

Maybe results could be loaded from resultsdb:

https://resultsdb.fedoraproject.org/results?item:like=python-lit*&since=2022-08-15T00:00:00,2022-09-13T23:59:59

But because we are on the path to deprecate after merge testing, I would say the current state of showing testing results for merge requests looks sufficient. Sooner or later, also generic Fedora CI tests should appear there.

> Considering only less than 2% of our components have tmt tests I am afraid this might be too noisy. Maybe a small icon with hover text would be better? Next to FTBFS and similar? > Where would we look for this kind of information? Doesn't necessarily have to be an API, I generally have no idea where I would look this up as human user either. Maybe results could be loaded from resultsdb: https://resultsdb.fedoraproject.org/results?item:like=python-lit*&since=2022-08-15T00:00:00,2022-09-13T23:59:59 But because we are on the path to deprecate after merge testing, I would say the current state of showing testing results for merge requests looks sufficient. Sooner or later, also generic Fedora CI tests should appear there.