# robots.txt for TechDistri Limited # Allow all crawlers to index main pages User-agent: * Disallow: /admin/ Disallow: /partner/ Disallow: /register/ Disallow: /password-reset/ Disallow: /checkout/ Disallow: /cart/ Disallow: /api/ Disallow: /vendor/ # Sitemap location Sitemap: https://www.techdistri.com/sitemap.xml # Crawl-delay (optional, for heavy servers) Crawl-delay: 5