-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512

Hi,

As some of you might have noticed, we are currently getting a lot of requests sent to packages, which is caused by search engines. Since engines don't have any use in packages since it's just an aggregator, I would like to disallow their access.

Can I get +1s on the following patch?

- -- With kind regards, Patrick Uiterwijk Fedora Infra

commit 25f71933abb4c571948454fc7507d190e1b34b06 Author: Patrick Uiterwijk puiterwijk@redhat.com Date: Mon Sep 14 12:03:20 2015 +0000

Robots have no use in fedoracommunity as its just an aggregator

Signed-off-by: Patrick Uiterwijk puiterwijk@redhat.com

diff --git a/roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org b/roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org new file mode 100644 index 0000000..31e3660 - --- /dev/null +++ b/roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org @@ -0,0 +1,3 @@ +User-agent: * +Disallow: /packages/ +Crawl-delay: 1

_______________________________________________ infrastructure mailing list infrastructure@lists.fedoraproject.org http://lists.fedoraproject.org/postorius/infrastructure@lists.fedoraproject....