fuck robots
This commit is contained in:
parent
b8e9086f87
commit
370e4f8643
1 changed files with 5 additions and 0 deletions
5
templates/robots.txt
Normal file
5
templates/robots.txt
Normal file
|
@ -0,0 +1,5 @@
|
|||
# I do wonder how many bots actually respect this in <current year>
|
||||
# (this is set the way it is mostly out of curiosity to see if it even matters)
|
||||
# the spec allows comments so hopefully the comments don't break this...
|
||||
User-agent: *
|
||||
Disallow: /
|
Loading…
Add table
Reference in a new issue