.Google.com limits robots.txt support to 4 areas, clarifying its standpoint on unsupported regulations.Google simply sustains four details robots.txt fields.Unsupported regulations in robots.txt will be actually ignored.Take into consideration auditing your robots.txt data because of this upgrade.