.Google confines robots.txt help to four fields, clarifying its standpoint on in need of support directives.Google only assists four details robots.txt fields.In need of support regulations in robots.txt will be neglected.Take into consideration auditing your robots.txt files taking into account this upgrade.