# qonaqtar.kz — crawling policy.
# The landing page is the SEO surface. The app shell (/app) and guest
# invitation pages (/i/*) stay crawlable ON PURPOSE so their noindex meta
# is actually seen (a robots.txt Disallow would hide the noindex and let
# bare URLs linger in the index). Only non-HTML endpoints are disallowed.
#
# /start is the exception to that reasoning. It is the advertising entry
# point, and it WRITES: a GET creates a guest account. Letting crawlers
# walk it would mint a row per crawl. There is also nothing to index — it
# redirects to /app/ and renders nothing of its own — so the usual worry
# about hiding a noindex does not apply. The response additionally carries
# X-Robots-Tag: noindex for anything that ignores this file.
# Meta and the messengers must be able to reach /start: their crawlers
# fetch an advert's destination to review it and to build the link
# preview. Blocking them got an advert rejected. They cost a handful of
# guest rows a day, which guests:prune clears — a stopped campaign costs
# considerably more.
User-agent: facebookexternalhit
Allow: /
Disallow: /api/
Disallow: /uploads/

User-agent: facebookcatalog
Allow: /
Disallow: /api/
Disallow: /uploads/

User-agent: Twitterbot
Allow: /
Disallow: /api/
Disallow: /uploads/

User-agent: TelegramBot
Allow: /
Disallow: /api/
Disallow: /uploads/

User-agent: WhatsApp
Allow: /
Disallow: /api/
Disallow: /uploads/

User-agent: *
Allow: /
Disallow: /api/
Disallow: /uploads/
Disallow: /start

Sitemap: https://qonaqtar.kz/sitemap.xml