User-agent: * Disallow: /files Disallow: /ajax.php Disallow: /auth Allow: /