fureunoir/schon
fureunoir/schon
1
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Features: 1) Simplify robots.txt disallow rules with wildcard usage for better pattern matching;

Browse source 
Fixes: 1) None;

Extra: 1) Cleanup redundant entries in robots.txt for improved readability;
This commit is contained in:
Egor Pavlovich Gorbunov 2025-10-07 17:37:54 +03:00
parent dc4da60e82
commit 0752221d22
1 changed files with 5 additions and 8 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
core/static/robots_frontend.txt
View file

@ -1,12 +1,9 @@
User-agent: * User-agent: *
Disallow: /admin/ Disallow: /*/public/wishlist/
Disallow: /static/ Disallow: /*/public/cart/
Disallow: /media/ Disallow: /*/public/checkout/
Disallow: /public/wishlist/ Disallow: /*/auth/sign-in/
Disallow: /public/cart/ Disallow: /*/auth/sign-up/
Disallow: /public/checkout/
Disallow: /auth/sign-in/
Disallow: /auth/sign-up/
Allow: / Allow: /