Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
Advanced Search

Problem with robots.txt!

Go to solution Solved by paul2009,

Recommended Posts

Site URL: https://klikblicvijesti.info/

Hello everybody
I have a problem with a "mysterious" robots.txt file. It’s mysterious for the reason that I didn’t even create it however it appears and creates a problem for me in indexing my page by Google. When I enter the File Manager of my site I can't find robots.txt anywhere. It blocks my ads and I don't know how to remove it. Here is the contents of that robots.txt: User-Agent: *
Allow: / ads / preferences /
Allow: / gpt /
Allow: /pagead/show_ads.js
Allow: /pagead/js/adsbygoogle.js
Allow: /pagead/js/*/show_ads_impl.js
Allow: /static/glade.js
Allow: / static / glade /
Disallow: /
Noindex: /
The link for this robots.txt is https://googleads.g.doubleclick.net/robots.txt
Note: I found this problem through Google's rich results test. It is also stated that I have bugs in the javascript code. For errors in javascript I will contact the author of the topic however I need you to solve this problem with robots.txt. My wish is to remove it. These errors are listed as errors that make it difficult for Google to index my page.

Link to comment
  • Solution

A robots.txt file tells search engines which pages on your site they shouldn't crawl. All Squarespace sites use the same robots.txt file to help follow SEO best practices and keep your site Google-friendly. You cannot change it. 

For more information, see Understanding Google SEO emails and console errors.

Hi! I'm Paul, an independent Squarespace Consultant since 2007 and founder of SF Digital, building the features that Squarespace didn't include. Our mini-extensions allow you to pick dates in any format, show prices in other currencies, take orders without payment or improve your cartI value honesty, integrity, transparency and respect . Links in my posts may refer to SF Digital products or may be affiliate links.

Link to comment

Create an account or sign in to comment

You need to be a member in order to leave a comment

  • Create New...