Age | Commit message (Collapse) | Author | Files | Lines | |
---|---|---|---|---|---|
2013-06-17 | Bug 883013: googlebot is indexing more pages than it should | Byron Jones | 1 | -11/+12 | |
2013-04-11 | Bug 860797 - add product dashboards to robots.txt | Dave Lawrence | 1 | -0/+1 | |
2013-02-15 | Bug 839970 - sitemap extension needs to allow access to ↵ | Dave Lawrence | 1 | -0/+1 | |
data/SiteMapIndex/sitemap* in robots.txt | |||||
2013-02-15 | Bug 839969 - Allow describekeywords.cgi in robots.txt | Dave Lawrence | 1 | -0/+1 | |
2011-11-11 | Bug 700876 - robots.txt - discourage search engines from indexing duplicate ↵ | Dave Lawrence | 1 | -3/+4 | |
information r=glob | |||||
2011-10-05 | more porting work | David Lawrence | 1 | -2/+11 | |
2002-04-25 | Bug 139800 - remove errant references to index.html. Patch by ddk, 2xr=gerv. | gerv%gerv.net | 1 | -1/+1 | |
2000-07-29 | If the application is set up at the server root (e.g. bugzilla.mozilla.org) ↵ | endico%mozilla.org | 1 | -0/+3 | |
then this robots.txt disallows robots from scanning the site except for the top level file. |