# The robot.txt tells robots (spiders) which files it may spider (download). This system 
# is called, The Robots Exclusion Standard.
# 
# The format for the robots.txt file is special. It consists of records. 
# Each record consists of two fields : a User-agent line and one or more 
# Disallow: lines. The format is:
#	<Field> ":" <value>

User-Agent: *
Disallow: /methew/
Disallow: /sylvia/
Disallow: /nikkels/
Disallow: /sander/
Disallow: /admin/
Disallow: /css/
Disallow: /edit/
Disallow: /docs/
Disallow: /error/
Disallow: /els/
Disallow: /info/
Disallow: /images/
Disallow: /new/