Removing Allow from ukwa/ukwa-services#96 due to concerns about block…

…ing.
ukwa · May 25, 2023 · 0358640 · 0358640
1 parent 3d5cabf
commit 0358640
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/static/robots.txt b/static/robots.txt
@@ -5,7 +5,7 @@ User-agent: *
 
 # Allow search engines to index specific sites:
 # As requested in https://github.com/ukwa/ukwa-services/issues/96
-Allow: /wayback/archive/*/http://www.europeandialogue.org/*
+#Allow: /wayback/archive/*/http://www.europeandialogue.org/*
 
 # Otherwise, avoid archives copies of websites interfering with live sites search presence:
 Disallow: /wayback/
@@ -30,4 +30,4 @@ Allow: /wayback/
 #
 # Add Site Map (created by static site generator):
 #
-Sitemap: /sitemap.xml
+Sitemap: /sitemap.xml