Documentation/web/server/robots.txt

   1 # avoid 404s -- so that we can take action if any occur in /stats
   2
   3 User-agent: *
   4 Disallow: /doc/v1.6/
   5 Disallow: /doc/v1.8/
   6 Disallow: /doc/v1.9/
   7 Disallow: /doc/v2.0/
   8 Disallow: /doc/v2.1/
   9 Disallow: /doc/v2.2/
  10 Disallow: /doc/v2.3/
  11 Disallow: /doc/v2.4/
  12 Disallow: /doc/v2.5/
  13 Disallow: /doc/v2.6/
  14 Disallow: /doc/v2.7/
  15 Disallow: /doc/v2.8/
  16 Disallow: /doc/v2.9/
  17 Disallow: /doc/v2.10/
  18 Disallow: /doc/v2.11/
  19 Disallow: /doc/v2.13/