Jump to content

Problem with robots.txt!

Recommended Posts

Site URL: https://klikblicvijesti.info/

Hello everybody
I have a problem with a "mysterious" robots.txt file. It’s mysterious for the reason that I didn’t even create it however it appears and creates a problem for me in indexing my page by Google. When I enter the File Manager of my site I can't find robots.txt anywhere. It blocks my ads and I don't know how to remove it. Here is the contents of that robots.txt: User-Agent: *
Allow: / ads / preferences /
Allow: / gpt /
Allow: /pagead/show_ads.js
Allow: /pagead/js/adsbygoogle.js
Allow: /pagead/js/*/show_ads_impl.js
Allow: /static/glade.js
Allow: / static / glade /
Disallow: /
Noindex: /
The link for this robots.txt is https://googleads.g.doubleclick.net/robots.txt
Note: I found this problem through Google's rich results test. It is also stated that I have bugs in the javascript code. For errors in javascript I will contact the author of the topic however I need you to solve this problem with robots.txt. My wish is to remove it. These errors are listed as errors that make it difficult for Google to index my page.

Link to comment
  • Replies 2
  • Views 2.3k
  • Created
  • Last Reply

A robots.txt file tells search engines which pages on your site they shouldn't crawl. All Squarespace sites use the same robots.txt file to help follow SEO best practices and keep your site Google-friendly. You cannot change it. 

For more information, see Understanding Google SEO emails and console errors.

Me: I'm Paul, a SQSP user for >18 yrs & Circle Leader since 2017. I value honesty, transparency, diversity and good design ♥.
Work: Founder of SF.DIGITAL. We provide high quality original extensions to supercharge your Squarespace website. 
Content: Views and opinions are my own. Links in my posts may refer to my own SF.DIGITAL products or may be affiliate links.
Forum advice is completely free. You can thank me by selecting a feedback emoji. Buying a coffee is generous but optional.

Link to comment

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Squarespace Webinars

Free online sessions where you’ll learn the basics and refine your Squarespace skills.

Hire a Designer

Stand out online with the help of an experienced designer or developer.