Skip to content

fix(site): allow /api/og/ and social card crawlers in robots.txt - #776

Merged
codercatdev merged 3 commits into
devfrom
fix/robots-allow-og-images
Oct 22, 2026
Merged

codercatdev merged 3 commits into
devfrom
fix/robots-allow-og-images

Conversation

@codercatdev

Copy link
Copy Markdown
Contributor

Allows /api/og/ and Twitterbot/facebookexternalhit/LinkedInBot in robots.txt so X and social card scrapers are not blocked by Disallow: /api/ when fetching OG card images.

@github-actions

Copy link
Copy Markdown

⚡ Cloudflare Worker Preview Ready!

Environment URL
PR Preview https://9cf2e1fe-codingcatdev-dev.codingcatdev.workers.dev
Dev Custom Domain https://dev.codingcat.dev
  • Worker Version ID: 9cf2e1fe-a6be-413c-91d1-6fdcfbabc8e2
  • Protection: Restricted to @codingcat.dev accounts via Cloudflare Zero Trust Access

@codercatdev
codercatdev merged commit 4b87330 into dev Oct 22, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant