Google To Bid Adieu To Its Unsupported Robots.txt Code

Google might bid a goodbye to the unsupported lines of code in the robots.txt file. These enable websites to instruct regarding how the search algorithm should crawl and index their site.

Website therefore need to work on finding an alternative before the 1st of September.

Some of the alternatives by Google include using the no index directives on robots meta tags, using 404 or 410 HTTP status, password protecting pages and Google's Search Console Remove URL tool.

Google wanta to focus on having a uniform set of rules for people looking to follow.