Personal #sysadmin#google#web 1 min

Removing a URL indexed by Google

Translation of the original in Catalan. Read it in: CatalàCastellano

It is a case I have not needed personally but that yesterday Law had to explain to me how it is done in order to help Martin. The thing is quite simple, the bots of google are very restless and at a given moment they can come to index websites or parts of websites that we do not want to be accessible through the search engine. Well then, if you have the need to remove something that you did not want to be indexed you have to remove it through the google webmaster tools, specifically in the following screenshot you can see the exact section where to do it.

google-remove.png
Google Webmaster Tools - Remove URL

Well then after filling in the process properly and in about 48h the URL should stop being indexed.

On the other hand, and so that this does not happen again it is important that at the root of your web server you add, if you do not have it, the file robots.txt. With, for example, the following contents:

  • Example 1: No robot of any search engine indexes anything from our site
User-agent: *
Disallow: /
  • Example 2: No robot of any search engine indexes anything from the URI /admimn/.
User-agent: *
Disallow: /admin/

In principle with this pair of ideas it should be enough for you to sleep peacefully.