User-agent: * Disallow: /*?* Disallow: /shop Disallow: /ask/ask-*.html Disallow: /article/article-*.html User-agent: Baiduspider Disallow: /ticket-d-*.html Disallow: /ticket-s-*.html Allow: /ticket-c-*.html Disallow: /ticket-c-*-*.html User-agent: * Disallow: /ticket-c-*-*.html User-agent: GPTBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Dart Disallow: / User-agent: BLEXBot Disallow: / User-agent: DotBot Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: serpstatbot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: AwarioBot Disallow: / User-agent: Applebot Disallow: /