User-Agent: * Disallow: /internal/failure.php Disallow: /internal/login.php Disallow: /internal/email.php Disallow: /catalogue/unit.php Disallow: contact.php Allow: /