# Datei robots.txt im Hauptverzeichnis der Domain User-agent: * Disallow: /blog/cgi-bin Disallow: /blog/wp-admin Disallow: /blog/wp-includes Disallow: /blog/wp-content/plugins Disallow: /blog/wp-content/cache Disallow: /blog/wp-content/themes Disallow: /blog/trackback Disallow: /blog/comments Disallow: /blog/category/*/* Disallow: /blog/*/trackback Disallow: /blog/*/comments Disallow: /blog/*?* Disallow: /blog/*? Allow: /blog/wp-content/uploads # Google Image User-agent: Googlebot-Image Disallow: Allow: /* # Google AdSense User-agent: Mediapartners-Google* Disallow: Allow: /* # Internet Archiver Wayback Machine User-agent: ia_archiver Disallow: / # digg mirror User-agent: duggmirror Disallow: / # Falls eine sitemap.xml erzeugt wurde Sitemap: https://intu.io/sitemap.xml Sitemap: https://intu.io/blog/sitemap_index.xml