# All robots will spider the domain User-agent: * Disallow: # Disallow directory templates User-agent: * Disallow: templates # Disallow directory images User-agent: * Disallow: images # Disallow directory css User-agent: * Disallow: css # Disallow directory cgi-bin User-agent: * Disallow: cgi-bin # Disallow directory events User-agent: * Disallow: events # Disallow directory classes User-agent: * Disallow: classes # Disallow directory life User-agent: * Disallow: life # Disallow directory travel User-agent: * Disallow: travel # Disallow directory business User-agent: * Disallow: business