# Robots.txt file from http://www.we-know.cn # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /bak/ Disallow: /data/ Disallow: /inc/ Disallow: /js/