User-agent: Ask Jeeves/Teoma Disallow: /stat/ User-agent: * Disallow: /admin.cgi Crawl-delay: 13 User-agent: Yandex Crawl-delay: 1.0