Ghady Posted January 1, 2020 Share Posted January 1, 2020 Hello, It's been a while since I've been facing this issue and there seems to be no solution. I've submitted a sitemap of my website to Google Search Console which was successful, but every time I request Google to index my website, it always ends up with a warning "Indexed, though blocked by robots.txt" meaning the site isn't indexed by Google. (My site is https://mastercarsreview.com/) Did anyone face such problem? How did you fix it? Thank you so much in advance. I really need help in this. (I've sent several emails to both squarespace and google, nothing changed) MajPil 1 Link to comment
Solution paul2009 Posted January 1, 2020 Solution Share Posted January 1, 2020 This is completely normal, and you can ignore the message. Your site has been indexed by Google. Squarespace use a robots.txt file to ask Google not to crawl certain pages because they’re for internal use only or display duplicate content. For example, you would not want them to index the /config/ url that you use to administer your website. For more detailed information see Understanding Google SEO emails and console errors. SodaCreekDigital, Ghady, amberwavescreative and 2 others 5 About: SQSP User for 17 yrs. Circle Leader since 2017. I value honesty, transparency, diversity and good design ♥. Work: Founder of SF Digital, building Squarespace Extensions to supercharge your commerce website. Content: Links in my posts may refer to SF Digital products or may be affiliate links. If my advice helped, you can thank me by clicking one of the feedback emojis below. I love coffee too. Link to comment
JohnVoung Posted January 16, 2020 Share Posted January 16, 2020 Just leave them because that’s not going to hurt your site in any way. In this case, what new GSC is reporting is what’s happening with your site and giving you some information to improve your site. They are blocked by the robots.txt file and the Google bot respects robots.txt and does not crawl those pages but they will be indexed in a scenario when those URLs could be linked to from other pages on your site. In this situation Google will index if they are linked to from external url source as well. Better to click the "Fix Coverage issues". Ghady 1 Link to comment
ArneEvertsson Posted December 20, 2020 Share Posted December 20, 2020 Why doesn't Squarespace make sure those pages are not indexed? That would remove the error message. amberwavescreative and kinnoda 2 Link to comment
EQLIFESUE Posted Sunday at 02:55 PM Share Posted Sunday at 02:55 PM What if it is a page you want indexed, as it is a sales page, and it is being blocked by /robots.txt:22 and not iindexed: Sunshirts — Equestrian Sunshirts — Equestrian Lifestyle Clothing How do you get rid of it? sue bulman Link to comment
paul2009 Posted Sunday at 03:29 PM Share Posted Sunday at 03:29 PM (edited) 42 minutes ago, EQLIFESUE said: What if it is a page you want indexed, as it is a sales page Hi Sue. I appreciate this can be confusing but it is working correctly. You don't want this link indexed. This is because the link you've quoted (the one that ends with /sunshirts/sunshirts?tag=Sunshirt) is a link to the products tagged "Sunshirt" on the sunshirt page. Squarespace asks Google not to crawl this URL because the same content will be indexed on the sunshirts page (but without the tag) at https://www.equestrianlifestyle.ca/sunshirts. If it were indexed a second time it would be considered duplicate content, and this doesn't help SEO. I hope this makes sense. Did this help? Please give feedback by clicking an icon below ⬇️ Edited Sunday at 03:37 PM by paul2009 MajPil 1 About: SQSP User for 17 yrs. Circle Leader since 2017. I value honesty, transparency, diversity and good design ♥. Work: Founder of SF Digital, building Squarespace Extensions to supercharge your commerce website. Content: Links in my posts may refer to SF Digital products or may be affiliate links. If my advice helped, you can thank me by clicking one of the feedback emojis below. I love coffee too. Link to comment
EQLIFESUE Posted Sunday at 07:35 PM Share Posted Sunday at 07:35 PM ok, that makes sense, i guess. All the other main product pages are indexed, so I was confused Sue Link to comment
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment