From 370e4f8643a3f5778c2ff32989a57812321f17e6 Mon Sep 17 00:00:00 2001 From: lynxize Date: Fri, 15 Nov 2024 22:59:25 -0700 Subject: [PATCH] fuck robots --- templates/robots.txt | 5 +++++ 1 file changed, 5 insertions(+) create mode 100644 templates/robots.txt diff --git a/templates/robots.txt b/templates/robots.txt new file mode 100644 index 0000000..30bc4ca --- /dev/null +++ b/templates/robots.txt @@ -0,0 +1,5 @@ +# I do wonder how many bots actually respect this in +# (this is set the way it is mostly out of curiosity to see if it even matters) +# the spec allows comments so hopefully the comments don't break this... +User-agent: * +Disallow: /