| commit | d10d5a593f60ce3645bdd55da1a3a6733a4f6dc8 | [log] [tgz] |
|---|---|---|
| author | Akron <nils@diewald-online.de> | Thu May 28 11:36:14 2026 +0200 |
| committer | Akron <nils@diewald-online.de> | Thu May 28 11:36:14 2026 +0200 |
| tree | 37248503d83753ff74f71df58367c645a1240df5 | |
| parent | a16750213b95df2aa6a0f62132aad63f37b5387d [diff] |
Update robots.txt Change-Id: Ia5944b06b5f33fc92c9dfd5a81836f23570e5c4f
diff --git a/public/robots.txt b/public/robots.txt new file mode 100644 index 0000000..2c03631 --- /dev/null +++ b/public/robots.txt
@@ -0,0 +1,11 @@ +# robots.txt only applies, when KorAP is accessible +# from the domain root. + +User-agent: * +Disallow: /api/ +Disallow: /css/ +Disallow: /font/ +Disallow: /js/ +Disallow: /settings/ +Disallow: /corpus/ +Disallow: /gerrit/