# robots.txt file start

# Exclude Files From All Robots:

User-agent: *
Disallow: /admin/
Disallow: /Arts/ShowSoftDown.asp
Disallow: /Soft/ShowSoftDown.asp
Disallow: /Children/ShowSoftDown.asp
Disallow: /Community/ShowSoftDown.asp
Disallow: /Comprehensive/ShowSoftDown.asp
Disallow: /computer/ShowSoftDown.asp
Disallow: /Education/ShowSoftDown.asp
Disallow: /English/ShowSoftDown.asp
Disallow: /Entertainment/ShowSoftDown.asp
Disallow: /Humanities/ShowSoftDown.asp
Disallow: /Languages/ShowSoftDown.asp
Disallow: /Life/ShowSoftDown.asp
Disallow: /Management/ShowSoftDown.asp
Disallow: /Material/ShowSoftDown.asp
Disallow: /Technology/ShowSoftDown.asp
Disallow: /photo/

# End robots.txt file

# 有#号的都是注释，方便阅读。
# User-agent就是搜索引擎的蜘蛛，后面用了*号，表示对所有的蜘蛛有效。
# Disallow就是表示不允许抓取，后面的目录或者文件，表示禁止抓取的范围。