User-Agent: * Allow: /artikul.html?id=* Disallow: /*? Disallow: /comments* Disallow: /search/ Disallow: */down/ Disallow: */up/ Disallow: */on/ Disallow: */all/ Disallow: /order.html Disallow: /login.html Disallow: /reg.html Sitemap: https://tovar2.ru/api-tovar2/xml/sitemaps/sitemap.xml Crawl-delay: 2 User-agent: Yandex Disallow: /*? Disallow: /comments* Disallow: /search/ Disallow: */down/ Disallow: */up/ Disallow: */on/ Disallow: */all/ Disallow: /order.html Disallow: /login.html Disallow: /reg.html Host: https://tovar2.ru Sitemap: https://tovar2.ru/api-tovar2/xml/sitemaps/sitemap.xml Crawl-delay: 2