User-agent: * Disallow: /redirect/ Disallow: /register/ Disallow: /login/