Documentation/web/server/robots.txt

   1 # avoid 404s -- so that we can take action if any occur in /stats
   2 # Comment from Phil 9 July 2013 to allow tracking file through build
   3
   4 User-agent: *
   5 Disallow: /doc/v1.6/
   6 Disallow: /doc/v1.8/
   7 Disallow: /doc/v1.9/
   8 Disallow: /doc/v2.0/
   9 Disallow: /doc/v2.1/
  10 Disallow: /doc/v2.2/
  11 Disallow: /doc/v2.3/
  12 Disallow: /doc/v2.4/
  13 Disallow: /doc/v2.5/
  14 Disallow: /doc/v2.6/
  15 Disallow: /doc/v2.7/
  16 Disallow: /doc/v2.8/
  17 Disallow: /doc/v2.9/
  18 Disallow: /doc/v2.10/
  19 Disallow: /doc/v2.11/
  20 Disallow: /doc/v2.12/
  21 Disallow: /doc/v2.13/
  22 Disallow: /doc/v2.14/
  23 Disallow: /doc/v2.15/
  24
  25 Disallow: /web/