# All robots will spider the domain User-agent: * Disallow: # Disallow directory /nav User-agent: * Disallow: /nav # Disallow directory /awards User-agent: * Disallow: /awards # Disallow directory /pics User-agent: * Disallow: /pics User_agent: * Disallow: *.js