1
0
Fork 0
forked from infra/ansible
Commit graph

99 commits

Author SHA1 Message Date
f97891fe72 kojipkgs: disallow indexes on compose/{iot|ostree}/objects too
These directories have 32k entries and when scrapers hit them it causes
kojipkgs to slow to a crawl since it takes minutes to stat all those
files. There is no need to allow indexes here, as ostree doesn't need or
use them, so just disallow it so the scrapers don't nuke kojipkgs.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-06-09 08:23:58 -07:00
409b8614e7 kojipkgs: all options need - or + if any have it
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-03-12 12:29:42 -07:00
094eeb99e8 kojipkgs: disable indexes on ostree/repo/objects directories
These directories have usually around 32k objects in them.
This means when a client asks for a directory index for them
it takes kojipkgs a few minutes to actually generate it, because it has
to stat every single file in order to show timestamps and sizes.
This means it fills up all slots doing this and the proxies start
getting 503's from it on other requests.

I don't _think_ ostree needs this enabled for any reason.
If it did, it would always have been a problem.
I think it's just some clients/crawlers deciding they want the directory index.

So, lets just deny indexes on directories under there.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-03-12 12:12:16 -07:00
James Antill
26f36e0820 Second part of fixing the logrotate problem on kojipkgs*. #12398
Adds a script which will compress rotatelogs not being used and delete logs
after 8 days (same as logrotate).

Signed-off-by: James Antill <james@and.org>
2025-09-19 10:54:35 -04:00
6c85fda0c9 Mass remove/replace iad2 -> rdu3, 10.3. -> 10.16.
Signed-off-by: Nils Philippsen <nils@redhat.com>
2025-07-03 20:05:02 +02:00
2ec055db6f Use first uppercase letter for all handlers
This will unify all the handlers to use first uppercase letter for
ansible-lint to stop complaining.

I went through all `notify:` occurrences and fixed them by running
```
set TEXT "text_to_replace"; set REPLACEMENT "replacement_text"; git grep
-rlz "$TEXT" . | xargs -0 sed -i "s/$TEXT/$REPLACEMENT/g"
```

Then I went through all the changes and removed the ones that wasn't
expected to be changed.

Fixes https://pagure.io/fedora-infrastructure/issue/12391

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-10 20:31:49 +00:00
47c68f478d ansiblelint fixes - fqcn[action-core] - template to ansible.builtin.template
Replaces references to template: with ansible.builtin.template

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:30:29 +10:00
6a3816dfdc ansiblelint fixes-- fqcn[action-core] - copy to ansible.builtin.copy
Replaces many references to 'copy' with ansible.builtin.copy

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:43:31 +10:00
62952df107 ansiblelint fixes-- fqcn[action-core] - file to ansible.builtin.file
Replaces many references to  file: with ansible.builtin.file

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:41:52 +10:00
691adee6ee Fix name[casing] ansible-lint issues
fix 1900 failures of the following case issue:

`name[casing]: All names should start with an uppercase letter.`

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-14 20:20:07 +10:00
89f6f1fc32 Fix majority of remaining yamllint warnings and errors
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2024-11-28 17:31:45 +10:00
ff6fb2bc6c koji: add fedora_koji_archive06 volume
We need a new archive volume, so add 06 to all the same places 01-05
are.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-10 09:57:33 -08:00
Kalev Lember
0064e09bff kojipkgs: slightly relax openh264 blocking/redirect rules
Allow access to gstreamer1-plugin-openh264 package and new noopenh264
stub package that don't contain non-distributable code, while keeping
openh264* and mozilla-openh264* blocked.

See https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=2247274 for
"noopenh264" stub package review that makes it possible to build/ship
the gstreamer plugin in Fedora proper while keeping the
non-distributable openh264 package in Cisco repos.
2023-11-09 21:28:13 +01:00
8c7ac6fa45 kojipkgs: add restart on fail conf
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-19 10:13:41 -07:00
f9a0479732 kojipkgs: restart varnish on failure
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-19 10:11:49 -07:00
7984b46eb7 The great phx2 pruning run (1st cut).
Since we no longer have any machines in phx2, I have tried to remove
them from ansible. Note that there are still some places where we need
to remove them still: nagios, dhcp, named were not touched, and in cases
where it wasn't pretty clear what a conditional was doing I left it to
be cleaned up later.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-14 14:14:31 -07:00
Stephen Smoogen
08f622be41 remove db-koji0[12].phx2, sign-bridge01.phx2, fedocal01.phx2, nuancier01.phx2, nuancier02.phx2 2020-06-11 17:14:29 -04:00
Stephen Smoogen
1b487b34a0 replace some hardcoded phx2 items with hardcoded iad2 items for koji, pdc, and nagios 2020-06-10 07:25:38 -04:00
Stephen Smoogen
37915eaf25 put in patches to use wildcard2020 2020-04-24 21:34:26 +02:00
998e785a0c kojipkgs: also make sure archive05 is readable
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:22 +02:00
e943797217 koji_hub: add fedora_koji_archive05
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:21 +02:00
6a4dac866c nfs_client: fedora_koji_archive04 volume in all the right places
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:20 +02:00
8bae2ce0da koji / package archiving: Add fedora_koji_archive02 and fedora_koji_archive03
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:11 +02:00
49b07b4442 koji archiving: add 01 volume for more archiving builds.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:08 +02:00
9fe083738f kojipkgs: add first archive volume in to be accessable from kojipkgs users.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:07 +02:00
9289585d21 kojipkgs role: disable welcome.conf as it messes with haproxy heelth checks
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-04-03 17:15:30 +00:00
cd93e7a40b Revert "Remove apache level redirect too. It's an end of an era"
This reverts commit 77da49200f.
2019-02-07 11:32:46 +01:00
77da49200f Remove apache level redirect too. It's an end of an era
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-02-07 11:26:47 +01:00
b6cdc517c5 Move kojipkgs/atomic from the Apache level
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-02-07 11:22:40 +01:00
c0b64dc8dd Serve /ostree on kojipkgs
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-02-06 16:10:19 +01:00
Patrick Uiterwijk
0ba63db834 Make the atomic rewrite happen at the proxies
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-04-11 11:49:51 -04:00
Patrick Uiterwijk
f5c246d5d0 Do not forward with X-CloudFront header
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-04-11 11:13:22 -04:00
Patrick Uiterwijk
8f7df9629c Close quotes
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-04-11 10:36:04 -04:00
Patrick Uiterwijk
6264d4e468 Redirect atomic/repo/objects via cloudfront
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-04-11 10:18:26 -04:00
8f7acb0dde Increase HSTS max age to one year
The HSTS preload list requires this now: https://hstspreload.org/
2018-02-07 12:42:36 +01:00
Stephen Smoogen
2734bbec05 move everything in staging except koji/proxy/pgdbr/pkgs to 10.5.128 2017-09-28 19:51:57 +00:00
Ricky Elrod
6747973914 Fix log names on kojipkgs by making it a template
Signed-off-by: Ricky Elrod <codeblock@fedoraproject.org>
2017-08-25 22:42:33 +00:00
Dennis Gilmore
71fdd658e4 make the changes for the right apache instance :D
Signed-off-by: Dennis Gilmore <ausil@fedoraproject.org>
2017-07-25 21:53:15 +00:00
b16bcd029f up the apache limit on kojipgks from default 256 to 512. This should hopefully stop issues with 256 requests at a time causing download errors for composes 2017-06-28 21:46:54 +00:00
Patrick Uiterwijk
f4f0d9338e Unset Accept-Encoding for kojipkgs
python-requests sets this to "gzip, deflate", and when it tries to download an aarch64 vmlinuz,
it gets (correctly) reported as Encoding: gzip.
This triggers automatic gzip decompression by urllib3, resulting in the following error:
Expected to download 6529431 bytes, downloaded 15618560

Unsetting Accept-Encoding request header tells mod_deflate it should not send the Encoding: gzip
header, avoiding the auto-decompression by urllib3.

Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2017-05-23 12:45:22 +00:00
Dennis Gilmore
2a2b8e8305 n an effort to be super awkward its named repos-dist not dist-repos
Signed-off-by: Dennis Gilmore <ausil@fedoraproject.org>
2017-05-03 13:48:13 +00:00
Dennis Gilmore
c9203a1b76 expose /dist-repos on kojipkgs
dist-repos the feature formerly known as signed-repos puts all of its
work under /mnt/koji/dist-repos/  so lets expose it to the world.

Signed-off-by: Dennis Gilmore <ausil@fedoraproject.org>
2017-05-03 13:28:48 +00:00
061e95e389 we need this /mnt/koji link 2017-04-07 20:19:27 +00:00
85b3c510c9 clean up kojipkgs role some 2017-04-07 19:47:51 +00:00
7437d0fa81 switch kojipkg01 to varnish too 2017-04-06 00:22:36 +00:00
6c6218d221 switch kojipkgs02 to use varnish instead of squid, leave 01 alone for now 2017-04-05 22:03:39 +00:00
Patrick Uiterwijk
6fee027d40 Combine all rules into one
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2017-02-02 20:52:55 +00:00
Patrick Uiterwijk
daef9222ad Fix sigul access to openh264
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2017-02-02 20:35:13 +00:00
e2318020ec set servername on kojipkgs 2017-02-02 01:25:42 +00:00
Stephen Smoogen
842ab9f67a and I forgot these 2017-02-02 00:12:43 +00:00