User-agent: *
Allow: /
Disallow: /admin/
Disallow: /engine/
Disallow: /goto/
Disallow: /search/

User-agent: Exabot
Dissalow: /