禁止搜索引擎搜索的文件或文件夹!
下面是例子:User-agent: *
Disallow: /css/
Disallow: /about/css/
Disallow: /about/help/css/
Disallow: /about/help/js/
Disallow: /bj/css/
Disallow: /html/php/
Disallow: /lp/css/
Disallow: /member/css/
Disallow: /mr/css/
Disallow: /ny/css/
Disallow: /order/js/
Disallow: /order/css/
Disallow: /product/js/
Disallow: /product/css/
Disallow: /pay/
Disallow: /th/css/
Disallow: /inc/
Disallow: /js/
Disallow: /sms/
Disallow: /xml/