# Disallow rules below block indexable duplicates discovered via Yandex Webmaster: # - /catalog?q=*, ?type=*, ?sortBy=* — search/filter views all serve the same # generic "Каталог каналов..." title; hundreds of duplicates polluted the index. # - ?etext=*, ?ybaip=*, ?search_source=* — Yandex Browser / Yandex Search referer # params that turned canonical URLs into noisy variants. # A specific bot block must repeat these rules because crawlers use ONLY their # matching User-agent block and ignore User-agent: *. User-agent: Googlebot Allow: / Disallow: /resource/ Disallow: /design Disallow: /catalog? Disallow: /*?q= Disallow: /*?type= Disallow: /*?sortBy= Disallow: /*?etext= Disallow: /*?ybaip= Disallow: /*?search_source= User-agent: Bingbot Allow: / Disallow: /resource/ Disallow: /design Disallow: /catalog? Disallow: /*?q= Disallow: /*?type= Disallow: /*?sortBy= Disallow: /*?etext= Disallow: /*?ybaip= Disallow: /*?search_source= User-agent: Twitterbot Allow: / Disallow: /resource/ Disallow: /design User-agent: facebookexternalhit Allow: / Disallow: /resource/ Disallow: /design User-agent: OAI-SearchBot Allow: / Disallow: /resource/ Disallow: /design User-agent: * Allow: / Disallow: /resource/ Disallow: /design Disallow: /catalog? Disallow: /*?q= Disallow: /*?type= Disallow: /*?sortBy= Disallow: /*?etext= Disallow: /*?ybaip= Disallow: /*?search_source= # Clean-param (директива Яндекса; YandexBot читает её из блока User-agent: *, т.к. отдельного # блока для него нет). Склеивает трекинговые параметры с каноническим URL → параметрические # клоны (?ysclid, ?utm_*) не обходятся и не индексируются отдельно, экономит crawl-budget. Clean-param: ysclid&utm_source&utm_medium&utm_campaign&utm_term&utm_content Sitemap: https://xn--80aakdatfmqiqnw.xn--p1ai/sitemap.xml