When convenient

Your site has no instructions file for search engines

This is the exact wording EverThread uses when it finds this on a customer's site, written for someone who runs a business, not a server. The example site here is yourbakery.com.

What we saw

There is no robots.txt file. Search engines look for it first.

Why it matters

Not a security problem, but it is where you keep admin pages and private areas out of Google.

How to fix it

Ask your developer to add a robots.txt that points to your sitemap and blocks admin and account areas.

For your developer

GET /robots.txt returned 404. Add one with a Sitemap: line and Disallow rules for admin/account paths.

Does your site have this?

Check it free, right now. We look at your home page the way a browser does and tell you in plain English. No account.

Or sign up free and we check it every day and email you when something changes.

Related