a574775086
Zabbix: use correct and not-typoed server target for maintainer_test hosts
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-22 15:44:08 +01:00
474152f472
Zabbix: use correct server target for maintainer_test hosts
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-22 15:35:53 +01:00
34bba84c4a
Zabbix: use correct server target for logdetective hosts
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-22 15:27:29 +01:00
47e4cedcff
Define openqa_env_prefix for servers
...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-21 00:11:49 +01:00
49f42faa1b
openQA etc: use a single-cert CA cert file for staging rabbitmq ( #13422 )
...
See infra/tickets#13422
for details on this. It seems like rabbitmq staging has been
switch to the 'new' CA cert, and the consumers don't actually
read/trust both certs in the combined CA cert file, only the
first (old) one, so they don't trust the new one. This should
deploy and use a new file with only the new CA cert in it. We
copy it out of the private repo for convenience but it's not
actually private, hence the 0644 perms.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-20 14:39:13 +02:00
7c8d8a1794
Revert "openQA: try using old pki cert/key on staging"
...
This reverts commit 293930446b
2026-06-20 11:19:24 +02:00
293930446b
openQA: try using old pki cert/key on staging
...
I'm having auth issues on openQA staging, I believe it *may* be
to do with the changes Aurelien made in
6fe8b98de21747dc16d59dcf5096da719a541296 . Let's see if using the
old key and cert helps.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-20 11:14:30 +02:00
73a749e915
Zabbix: add 100 to postfix queue triggers for smtp-mm
...
spammers are making the queues longer, lets allow a bit more headroom
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-19 13:11:56 +01:00
6de0108ef7
openQA dist-git PR test result reporting config (staging)
...
This *should* configure a new queue and consumer for openQA to
report dist-git PR test results back. It's all a bit speculative
ATM, may need some tweaking. Mostly applied only on staging for
now.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-19 13:25:02 +02:00
83f050747d
Add communishift copr project ( ticket 13409 )
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-18 15:20:46 -07:00
92ac345388
Zabbix: adjust ping threshold for proxy30 & 38
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-17 11:28:55 +01:00
0655279df0
Zabbix: make ping threshold trigger configurable
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-17 10:26:33 +01:00
c052919334
Zabbix: Update PGSQL lock thresholds for busy dbs, they seem fine
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-12 12:18:27 +01:00
Jakub Kadlcik
2e6e48414b
copr: upgrade builders to F44
...
Fix https://github.com/fedora-copr/copr/issues/4306
2026-06-11 13:57:33 +02:00
afb43fd7a2
Zabbix: make NFS lock check specific to koji01
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-11 12:46:53 +01:00
99fdaaf68d
openqa nftables: gah quickfix
...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-08 17:21:48 -07:00
b16be7cbdc
openqa: try and fix custom nftables rule
...
Looks like 'nat' was renamed, let's try using the variable.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-08 17:11:49 -07:00
36c203a312
openqa: use updates-testing on prod again
...
This is to get the latest snapshot packages that we've been
testing on staging, they look good.
2026-06-08 16:46:07 -07:00
cae07e65f6
f42-test: eol and terminated
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-08 11:58:50 -07:00
3a58e87f2f
proxy14: move to vmhost-x86-iso03
...
vmhost-x86-iso03 is empty and moving proxy14 off 04 will free up some
iops for download-iso01.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-08 10:18:15 -07:00
5a33ceb031
Mariadb: Enable backups on db03.stg
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-08 16:18:34 +01:00
9b7ad64e73
openqa: don't use updates-testing on prod workers
...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2026-06-05 16:34:29 -07:00
7fadab3b49
proxy110: move to vmhost-x86-03 so both it and 101 are not on the same virthost
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-05 13:59:25 -07:00
ccc038e3d4
zabbix: open port 10051 so agents can talk to servers
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-05 12:56:40 -07:00
2d031471c5
copr-be: re-enable vmhost-copr-04 after the service
...
infra/tickets#13275
2026-06-05 15:46:09 +02:00
Jakub Kadlcik
7e92010a30
copr-be-dev: update builder images to F44
...
See https://github.com/fedora-copr/copr/issues/4306
2026-06-05 12:20:39 +02:00
bac5b82bfd
Zabbix: copy CPU macro from copr-be to copr-be-dev
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-05 09:38:08 +01:00
17c185f2eb
Update all the hosts we upgraded to fedora 44 in the outage today
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-04 20:06:18 -07:00
9fa66d2441
proxies_stg: move to f44
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-04 12:39:55 -07:00
57a760e09c
Zabbix: port remaining Copr items from Nagios
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-04 16:54:37 +01:00
cf9c46c830
Zabbix: adjust copr-be cpu threshold
...
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2026-06-04 13:23:16 +01:00
52ac6c7ec6
pagure-stg-ro01: add new instance for readonly pagure in stg ( ticket 13351 )
...
For infra/tickets#13351
This makes a staging rhel10 vm thats just the same size / place
as pagure-stg01.
It still needs external ip's and nat in from those, but this should be
enough to install it and start setting things up.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-03 19:55:22 +00:00
ecd54431d7
smtp-mm-iso01: fix ipv6 address
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-03 09:18:08 -07:00
James Antill
5c6868260b
Merge branch 'nftables' into upstream
...
* nftables: (2 commits)
Cleanup nft merge. Chg osbuildapi and nft_custom_rules to use nft_table_filter.
...
Signed-off-by: James Antill <james@and.org>
2026-06-01 17:33:24 -04:00
Jiri Kyjovsky
259ec5b2e8
copr-be: enable rpmeta build time prediction (observability-only)
...
Deploy rpmeta config to copr-be.conf and hardware pools YAML with
real builder specs. Initially logging-only, does not affect VM allocation.
2026-06-01 17:21:57 +02:00
d830f9ae6e
copr: bump up number of reserved instances
2026-06-01 09:54:20 +02:00
8bbcceafdd
proxies: bump max connections fromm 3200 to 4000
...
It seems like the alerts we have been getting have been when proxies are
near the limit rejecting things via anubis, but unable to keep up.
So, lets try and jump this up a bit and see if it solves those
alerts/slowdowns.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-30 08:36:39 -07:00
71aec6a544
Move s390x staging builders and koji.stg hub to f44.
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-29 12:23:51 -07:00
06c765b10d
buildvm-x86: reinstall with fedora 44
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-29 11:24:25 -07:00
1be1c69f0f
proxy12: fix mac address
...
This had the hard coded mac address of the previous vm.
We moved to using ansible to just fill in the current mac, so fix that
here too.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-29 10:52:26 -07:00
63315f4602
proxy12: reinstall with f44
...
We need to do this anyhow, but this will test to see if the weird alerts
we have been getting persist on f44 with the latest libvirt machine
setup.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-29 10:10:44 -07:00
6a767b3706
always a missing :
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-28 16:21:54 -07:00
9d572f1839
add coreos-agent, rag-magazine-guidelines, and public-inboc-poc communishift projects
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-28 16:20:15 -07:00
bbf9258578
memcached02 (rhel9) retirement
...
We switched over to the rhel10 versions of these, so these are going
away. Thanks for your service!
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-27 13:48:59 -07:00
70cfd1412e
memcached01: use correct ip
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 17:38:05 -07:00
ccb89c99a4
memcached01: add a new prod memcached01
...
Once this is all setup we can switch to it and retire the rhel9 02.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 17:26:22 -07:00
7268404db7
memcached01.stg: add properly to stg group
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 17:06:58 -07:00
7e226ba150
memcached_stg: increase disk size
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 16:48:00 -07:00
f8fbb98eda
memcached01.stg: add a new rhel10 staging memcached
...
Once this is up and working, we can switch applications over to using
it, and retire the rhel9 one.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 16:38:28 -07:00
3ac21c8018
tang02: move to rhel10
...
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-05-26 16:00:47 -07:00
