Fixes: 1) Remove redundant `robots_frontend.txt` file and replace with consolidated `robots.txt` from `storefront/public`; Extra: 1) Standardize formatting of crawler directives in `robots.txt`. |
||
|---|---|---|
| .. | ||
| images | ||
| favicon.ico | ||
| robots.txt | ||
Fixes: 1) Remove redundant `robots_frontend.txt` file and replace with consolidated `robots.txt` from `storefront/public`; Extra: 1) Standardize formatting of crawler directives in `robots.txt`. |
||
|---|---|---|
| .. | ||
| images | ||
| favicon.ico | ||
| robots.txt | ||