From bc5a0d217631a86fad94eda5f2144b8913996531 Mon Sep 17 00:00:00 2001 From: Matthew Landauer Date: Fri, 22 Nov 2024 00:44:59 +0000 Subject: [PATCH] We don't want search engines to index the application interstitial pages --- public/robots.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/public/robots.txt b/public/robots.txt index ab792c03b..fb5656957 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -12,6 +12,7 @@ Disallow: /?*q= Disallow: /authorities/*/comments Allow: /applications/ Disallow: /applications +Disallow: /applications/*/external Disallow: /applications/*/nearby Disallow: /applications/search Disallow: /comments