Sure is great how Google will see your robots.txt, digest it, and then scrape those parts of your site anyway and then tell you "BTW I indexed this big part of your site but the searchability on it is bad because of your robots.txt rule, you should do something about that"
0 Boosts
0 Likes
No replies yet
Be the first to share your thoughts.