Thanks @MarkOrion for taking the time to answer! I know what robots.txt does technically.
I was rather trying to understand, if using robots.txt was the right way to avoid the Squarespace site search page from being indexed?
Google Search Console seems to suggest a different approach.
Site URL: https://daoethicalgifts.com/search
I recently included site search for our website. Apparently, Squarespace sets this type of page to "no index" per default by putting a block in the robots.txt. (Link to description in Squarespace help section)
Now, Google Search Console tells me that this is the wrong way to do it:
"If you do want to block this page from Google Search, robots.txt is not the correct mechanism to avoid being indexed. To avoid being indexed, remove the robots.txt block and use 'noindex'"
I am worried about the Squarespace default settings having a negative impact on our ranking. (How) can I manually change the settings? Or is this nothing to worry about?
Any recommendations or experience values are much appreciated!
DaoEthicalGifts got a reaction from jaisequoia in robots.txt error / Search page blocked by robots.txt instead of using "no index"
