jcline/ansible
1
0
Fork 0
forked from infra/ansible
Code Pull requests Activity

people robots.txt: disallow all of cgit

Browse source 
There's a flood ATM. Dunno if the flood respects robots.txt, but
if it does this might help?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
This commit is contained in:
Adam Williamson 2026-04-30 12:25:07 -07:00
commit 2dd39340ea
1 changed files with 1 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
roles/people/files/robots.txt
View file

@ -1,4 +1,2 @@
User-agent: *
Disallow: /cgit/*.tar.xz
Disallow: /cgit/*.tar.gz
Disallow: /cgit/*.zip
Disallow: /cgit