From e78d2fc65241a80fb2e17a392e167b5bdd48eb1d Mon Sep 17 00:00:00 2001
From: Alexandr SaVBaD Waltz <savbad@wiseless.xyz>
Date: Sat, 13 Sep 2025 12:59:53 +0300
Subject: [PATCH] Features: 1) Update `robots.txt` to include improved crawler
 directives for `/profile` while maintaining SEO sitemap and host details;

Fixes: 1) Remove redundant `robots_frontend.txt` file and replace with consolidated `robots.txt` from `storefront/public`;

Extra: 1) Standardize formatting of crawler directives in `robots.txt`.
---
 core/static/robots_frontend.txt | 11 -----------
 storefront/public/robots.txt    | 12 ++++++++++--
 2 files changed, 10 insertions(+), 13 deletions(-)
 delete mode 100644 core/static/robots_frontend.txt

diff --git a/core/static/robots_frontend.txt b/core/static/robots_frontend.txt
deleted file mode 100644
index 49febff4..00000000
--- a/core/static/robots_frontend.txt
+++ /dev/null
@@ -1,11 +0,0 @@
-User-agent: *
-Disallow: /admin/
-Disallow: /static/
-Disallow: /media/
-Disallow: /cart/
-Disallow: /account/
-
-Allow: /
-
-Sitemap: https://evibes.com/sitemap.xml
-Host: evibes.com
\ No newline at end of file
diff --git a/storefront/public/robots.txt b/storefront/public/robots.txt
index 0ad279c7..bd144fbc 100644
--- a/storefront/public/robots.txt
+++ b/storefront/public/robots.txt
@@ -1,2 +1,10 @@
-User-Agent: *
-Disallow:
+User-agent: *
+Disallow: /admin/
+Disallow: /static/
+Disallow: /media/
+Disallow: /profile/
+
+Allow: /
+
+Sitemap: https://evibes.com/sitemap.xml
+Host: evibes.com
\ No newline at end of file