User-agent: * Disallow: /*_noindex_ Disallow: /redirect/ Disallow: /web/ Disallow: /ver/ Disallow: /go/ Disallow: /buscar/ Disallow: /search/ Disallow: /tag/ Disallow: /private/ Disallow: /errores/ Disallow: /noindex/ Disallow: /upload/ Disallow: /mylocation/ Disallow: /terms$ User-agent: Mediapartners-Google User-agent: Adsbot-Google Disallow: /redirect/ Disallow: /web/ Disallow: /ver/ Disallow: /go/ Disallow: /buscar/ Disallow: /search/ Disallow: /tag/ Disallow: /private/ Disallow: /errores/ Disallow: /noindex/ Disallow: /upload/ Disallow: /mylocation/ Disallow: /terms$ User-agent: proximic Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: msnbot Crawl-delay: 20 User-agent: slurp Crawl-delay: 20 User-agent: GPTBot Disallow: /