# Robots.txt file # For domain: http://www.hssk.nl # All robots will spider the domain User-agent: * Disallow: # Disallow directory /forum/ User-agent: * Disallow: /forum/ # Disallow directory /files/ User-agent: * Disallow: /files/