# Indexability is gated on HOST by the application, which emits X-Robots-Tag on # every response from anywhere that is not the production host. This file is the # production policy; the header is what makes the demo safe regardless. User-agent: * Allow: / Disallow: /admin Disallow: /livewire/ Disallow: /teklif-iste Disallow: /en/request-quote Disallow: /tesekkurler Disallow: /en/thank-you # AI crawlers are allowed on purpose: the server-rendered HTML and the JSON-LD # graph are what they actually read, and this site has both. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://dorukmak.com/sitemap.xml