# All robots will spider the domain User-agent: * Disallow: # Disallow directory /alpha1/ User-agent: * Disallow: /alpha1/ # Disallow directory /alpha2/ User-agent: * Disallow: /alpha2/ # Disallow directory /private/ User-agent: * Disallow: /private/