diff options
| author | Mazdak Farrokhzad <twingoow@gmail.com> | 2019-04-14 00:23:50 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2019-04-14 00:23:50 +0200 |
| commit | cf370b40dc9955ed3cff90f94b96507513ad6ded (patch) | |
| tree | 9c813b5a9ac58b59d765a510e2f03c84446b6962 | |
| parent | 2413ac7956628438fc1619ff9d3dfe6558b96a10 (diff) | |
| parent | 0a9b214b503265e42e86ca7846577664efb1819e (diff) | |
| download | rust-cf370b40dc9955ed3cff90f94b96507513ad6ded.tar.gz rust-cf370b40dc9955ed3cff90f94b96507513ad6ded.zip | |
Rollup merge of #59930 - kornelski:first-robots, r=GuillaumeGomez
Exclude some copies of old book editions from search engines These are only stubs that confuse search engine users. There's no useful content in these locations.
| -rw-r--r-- | src/doc/robots.txt | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/src/doc/robots.txt b/src/doc/robots.txt index a54ec508c1b..61ee12739fb 100644 --- a/src/doc/robots.txt +++ b/src/doc/robots.txt @@ -17,3 +17,11 @@ Disallow: /1.0.0-beta.2/ Disallow: /1.0.0-beta.3/ Disallow: /1.0.0-beta.4/ Disallow: /1.0.0-beta.5/ +Disallow: /book/first-edition/ +Disallow: /book/second-edition/ +Disallow: /stable/book/first-edition/ +Disallow: /stable/book/second-edition/ +Disallow: /beta/book/first-edition/ +Disallow: /beta/book/second-edition/ +Disallow: /nightly/book/first-edition/ +Disallow: /nightly/book/second-edition/ |