User-agent: * Disallow: /admin Disallow: /_admin/ User-agent: Yandex Disallow: /admin Disallow: /_admin/ Crawl-delay: 0.5