5 lines
247 B
Text
5 lines
247 B
Text
# I do wonder how many bots actually respect this in <current year>
|
|
# (this is set the way it is mostly out of curiosity to see if it even matters)
|
|
# the spec allows comments so hopefully the comments don't break this...
|
|
User-agent: *
|
|
Disallow: /
|