schon/storefront/public/robots.txt
Alexandr SaVBaD Waltz e78d2fc652 Features: 1) Update robots.txt to include improved crawler directives for /profile while maintaining SEO sitemap and host details;
Fixes: 1) Remove redundant `robots_frontend.txt` file and replace with consolidated `robots.txt` from `storefront/public`;

Extra: 1) Standardize formatting of crawler directives in `robots.txt`.
2025-09-13 12:59:53 +03:00

10 lines
No EOL
156 B
Text

User-agent: *
Disallow: /admin/
Disallow: /static/
Disallow: /media/
Disallow: /profile/
Allow: /
Sitemap: https://evibes.com/sitemap.xml
Host: evibes.com