We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent e6238db commit 22e8114Copy full SHA for 22e8114
content/docs/reference/routes/public-access.mdx
@@ -26,7 +26,7 @@ Because the **Public Access** setting bypasses authentication and authorization
26
27
### Robots.txt behavior
28
29
-By default, Pomerium serves a custom **robots.txt** file that instructs user-agents _not_ to crawl a given route:
+By default, Pomerium serves a **robots.txt** response directly, instructing search engines _not_ to crawl the route domain:
30
31
```txt
32
User-agent: *
0 commit comments