Jump to content

Problem with robots.txt!

Go to solution Solved by paul2009,

Recommended Posts

Site URL: https://klikblicvijesti.info/

Hello everybody
I have a problem with a "mysterious" robots.txt file. It’s mysterious for the reason that I didn’t even create it however it appears and creates a problem for me in indexing my page by Google. When I enter the File Manager of my site I can't find robots.txt anywhere. It blocks my ads and I don't know how to remove it. Here is the contents of that robots.txt: User-Agent: *
Allow: / ads / preferences /
Allow: / gpt /
Allow: /pagead/show_ads.js
Allow: /pagead/js/adsbygoogle.js
Allow: /pagead/js/*/show_ads_impl.js
Allow: /static/glade.js
Allow: / static / glade /
Disallow: /
Noindex: /
The link for this robots.txt is https://googleads.g.doubleclick.net/robots.txt
Note: I found this problem through Google's rich results test. It is also stated that I have bugs in the javascript code. For errors in javascript I will contact the author of the topic however I need you to solve this problem with robots.txt. My wish is to remove it. These errors are listed as errors that make it difficult for Google to index my page.

Link to comment
  • Solution

A robots.txt file tells search engines which pages on your site they shouldn't crawl. All Squarespace sites use the same robots.txt file to help follow SEO best practices and keep your site Google-friendly. You cannot change it. 

For more information, see Understanding Google SEO emails and console errors.

About: Squarespace Circle Leader since 2017. I value honesty, transparency, diversity and great design ♥.
Work: Squarespace Developer and founder of SF Digital, building the features Squarespace didn't include™. 
Content: Links in my posts may refer to SF Digital products or may be affiliate links.

Catch up on all the release notes and announcements 2023 [for Circle members only]. There's a public version here too!
If I helped, you can thank me by clicking one of the emojis below. If you prefer, you can buy me a coffee.
Improve your online store with our extensions.

Link to comment

Create an account or sign in to comment

You need to be a member in order to leave a comment

×
×
  • Create New...

Squarespace Webinars

Free online sessions where you’ll learn the basics and refine your Squarespace skills.

Hire a Designer

Stand out online with the help of an experienced designer or developer.