# Robots.txt for https://deshishopper.xyz # Allow all crawlers User-agent: * # Allow crawling of all content Allow: / # Disallow admin and private areas Disallow: /admin/ Disallow: /api/ Disallow: /_next/ Disallow: /user/ Disallow: /checkout/ # Sitemap location Sitemap: https://deshishopper.xyz/sitemap.xml # Crawl delay (optional) Crawl-delay: 1