diff options
| author | David Lawrence <dlawrence@mozilla.com> | 2011-10-05 00:25:23 +0200 |
|---|---|---|
| committer | David Lawrence <dlawrence@mozilla.com> | 2011-10-05 00:25:23 +0200 |
| commit | 57584dc4744fea59833ef355f7513690d246c70f (patch) | |
| tree | 805f2b2941eca17eaf97263165d11d9e676ad9d1 /robots.txt | |
| parent | 785580c6c290b93fe25868cfbb5d4e300749de62 (diff) | |
| download | bugzilla-57584dc4744fea59833ef355f7513690d246c70f.tar.gz bugzilla-57584dc4744fea59833ef355f7513690d246c70f.tar.xz | |
more porting work
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 13 |
1 files changed, 11 insertions, 2 deletions
diff --git a/robots.txt b/robots.txt index 0f823cb24..6759c00b1 100644 --- a/robots.txt +++ b/robots.txt @@ -1,3 +1,12 @@ +User-agent: Browsershots +Disallow: + User-agent: * -Allow: /index.cgi -Disallow: / +Disallow: /*.cgi +Disallow: /*show_bug.cgi*ctype=* +Allow: / +Allow: /*index.cgi +Allow: /*page.cgi +Allow: /*show_bug.cgi +Allow: /*describecomponents.cgi +Sitemap: http://bugzilla.mozilla.org/page.cgi?id=sitemap/sitemap.xml |