diff options
| author | Kornel <kornel@geekhood.net> | 2019-03-15 15:04:34 +0000 |
|---|---|---|
| committer | Kornel <kornel@geekhood.net> | 2019-03-15 15:05:12 +0000 |
| commit | fbc4326f4b249413fd71fe11a93ecf11f7533116 (patch) | |
| tree | 4e26133cd476ea6af4636d3e8baa54f572902596 | |
| parent | bc44841ad2a2ad5f6c5e67b9e35ed8e7e71d4dc7 (diff) | |
| download | rust-fbc4326f4b249413fd71fe11a93ecf11f7533116.tar.gz rust-fbc4326f4b249413fd71fe11a93ecf11f7533116.zip | |
Track changes to robots.txt
| -rw-r--r-- | src/doc/robots.txt | 19 |
1 files changed, 19 insertions, 0 deletions
diff --git a/src/doc/robots.txt b/src/doc/robots.txt new file mode 100644 index 00000000000..a54ec508c1b --- /dev/null +++ b/src/doc/robots.txt @@ -0,0 +1,19 @@ +# NB: This file is not automatically deployed. After changes, it needs to be uploaded manually to doc.rust-lang.org +User-agent: * +Disallow: /0.3/ +Disallow: /0.4/ +Disallow: /0.5/ +Disallow: /0.6/ +Disallow: /0.7/ +Disallow: /0.8/ +Disallow: /0.9/ +Disallow: /0.10/ +Disallow: /0.11.0/ +Disallow: /0.12.0/ +Disallow: /1.0.0-alpha/ +Disallow: /1.0.0-alpha.2/ +Disallow: /1.0.0-beta/ +Disallow: /1.0.0-beta.2/ +Disallow: /1.0.0-beta.3/ +Disallow: /1.0.0-beta.4/ +Disallow: /1.0.0-beta.5/ |