From aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc Mon Sep 17 00:00:00 2001
From: "endico%mozilla.org" <>
Date: Sat, 29 Jul 2000 04:28:39 +0000
Subject: If the application is set up at the server root (e.g.
 bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the
 site except for the top level file.

---
 robots.txt | 3 +++
 1 file changed, 3 insertions(+)
 create mode 100644 robots.txt

(limited to 'robots.txt')

diff --git a/robots.txt b/robots.txt
new file mode 100644
index 000000000..c364fe62e
--- /dev/null
+++ b/robots.txt
@@ -0,0 +1,3 @@
+User-agent: *
+Allow: /index.html
+Disallow: /
-- 
cgit v1.2.3-24-g4f1b