User-agent: Twitterbot Disallow: Allow: /p/ User-agent: facebookexternalhit/1.1 Disallow: Allow: /p/ # robots.txt rules are prefix matches, not path segments. "Disallow: /p" # blocked /pricing and /privacy-for-districts as well as the /p/ share links # (GSC: "Indexed, though blocked by robots.txt"). Every rule below ends in a # slash so it can only match a directory; where the bare path is private too # it is anchored with "$" rather than left to swallow future sibling pages. # "$" anchors the end of the whole URL, query string included, so the bare # path needs a companion "?" rule: /app?utm_source=... (the pricing page's # trial CTA) and /app?__tac_refresh=... are URLs the site really produces. User-agent: * Disallow: /p/ Disallow: /player$ Disallow: /player? Disallow: /player/ Disallow: /app$ Disallow: /app? Disallow: /app/ Disallow: /api/ Disallow: /tacadmin/ Allow: /resources/ Allow: /company/ Allow: /support/ Allow: /legal/ Allow: /creators Allow: /contact-sales Sitemap: https://talkandcomment.com/sitemap.xml