Skip to content

docs(session-replay): point the image bot page at the public specification - #19490

Draft
robbie-c wants to merge 3 commits into
masterfrom
claude/image-bot-docs-link
Draft

docs(session-replay): point the image bot page at the public specification#19490
robbie-c wants to merge 3 commits into
masterfrom
claude/image-bot-docs-link

Conversation

@robbie-c

Copy link
Copy Markdown
Member

Problem

The image bot page restated how the bot behaves: robots.txt, Crawl-delay, rate limits, and what it does with a 429 or a 503.

The specification README in PostHog/posthog states the same things, and it is public. Two copies of one set of rules drift apart, and the page is the copy that gets stale, because the rules change with the code.

Changes

  • The page links to the image fetch lane README.
  • It keeps the two facts the README does not carry: the bot sends no cookies, no credentials and no Referer, and it does not crawl or index.
  • Crawl-delay moves to "How to block it", next to the robots.txt example, because a reader who wants to slow the bot down looks there.
  • "It only requests images" becomes a statement that it does not crawl or index. The bot also requests the files it needs to read before it may fetch, such as robots.txt, so the original sentence would have been wrong.

How did you test this code?

  • Read the rendered markdown. The link resolves to the README on master.
  • Checked each removed bullet against the specification, so nothing was cut that the README does not state.

🤖 Agent context

Autonomy: Human-driven (agent-assisted)

Robbie asked for the link and for the duplicate information to go. I (actually Claude) checked which bullets the README covers before removing them, which is how the cookies and Referer bullet survived: the specification never mentions either, so the page is the only place that promises it.

Skills invoked: /writing-user-facing-copy, /writing-pr-descriptions.

…ation

The page restated the bot's rate limits, robots.txt handling and retry
behaviour. The specification README says the same things and is public, so
the page now links to it and keeps only what the README does not cover.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@github-actions github-actions Bot added docs Improvements or additions to product documentation, "Docs" content PR only touches files under contents/ labels Aug 14, 2026
@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Deploy preview

Status Details Updated (UTC)
🟢 Ready View preview Aug 14, 2026 01:21PM

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Vale prose linter → found 0 errors, 2 warnings, 3 suggestions in your markdown

Full report → Copy the linter results into an LLM to batch-fix issues.

Linter being weird? Update the rules!

contents/docs/session-replay/image-bot.mdx — 0 errors, 2 warnings, 3 suggestions
Line Severity Message Rule
2:8 warning Capitalize 'Session Replay' for PostHog's product. Use 'Session replay' for the general industry concept. PostHogBase.ProductNames
29:1 suggestion Address the reader directly. Use 'you' instead of 'The user'. PostHogDocs.DirectAddress
61:20 suggestion Address the reader directly. Use 'you' instead of 'the user'. PostHogDocs.DirectAddress
69:60 warning Capitalize 'Logs' for PostHog's product. Use 'logs' for the general industry concept. PostHogBase.ProductNames
69:106 suggestion Address the reader directly. Use 'you' instead of 'the user'. PostHogDocs.DirectAddress

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Bundle report

Total JS (gzip)

7.55 MiB (no change)

Eager graph (modules shipped in each entrypoint's initial chunks)

Entrypoint Eager size Budget Modules
app 16.90 MiB (+0.0 KiB / +0.0%) report-only 2018
Largest modules in the app closure
Module Size
./src/data/mcp-tools.json 990.7 KiB
css ./node_modules/.pnpm/css-loader@5.2.7_webpack@5.101.3/node_modules/css-loader/dist/cjs.js??ruleSet[1].rules[8].oneOf[1].use[1]!./node_modules/.pnpm/postcss-loader@4.3.0_postcss@8.5.6_webpack@5.101.3/node_modules/postcss-loader/dist/cjs.js??ruleSet[1].rules[8].oneOf[1].use[2]!./src/styles/global.css 746.7 KiB
./src/components/Stickers/Stickers.tsx 696.4 KiB
./node_modules/.pnpm/@radix-ui+react-icons@1.3.2_react@18.3.1/node_modules/@radix-ui/react-icons/dist/react-icons.esm.js 481.4 KiB
./node_modules/.pnpm/rehype-raw@7.0.0/node_modules/rehype-raw/lib/index.js + 29 modules 395.1 KiB
./node_modules/.pnpm/@posthog+icons@0.36.6_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/@posthog/icons/dist/posthog-icons.cjs.js 364.8 KiB
./node_modules/.pnpm/@posthog+icons@0.36.6_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/@posthog/icons/dist/posthog-icons.es.js 354.8 KiB
./src/hooks/useCustomers.tsx + 54 modules 354.5 KiB
./node_modules/.pnpm/react-markdown@8.0.7_@types+react@16.14.66_react@18.3.1/node_modules/react-markdown/lib/react-markdown.js + 88 modules 351.4 KiB
./src/components/ProductComparisonTable/index.tsx + 126 modules 301.4 KiB
./node_modules/.pnpm/cloudinary-core@2.14.0_lodash@4.17.21/node_modules/cloudinary-core/cloudinary-core.js 281.9 KiB
./src/components/SearchUI/index.tsx + 87 modules 273.0 KiB
./node_modules/.pnpm/@posthog+brand@0.8.0_react@18.3.1/node_modules/@posthog/brand/dist/generated/hoggies/svg/magnifying-glass.mjs 254.7 KiB
./node_modules/.pnpm/framer-motion@10.18.0_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/framer-motion/dist/es/render/dom/motion.mjs + 109 modules 253.9 KiB
./node_modules/.pnpm/d3@7.9.0/node_modules/d3/src/index.js + 208 modules 247.4 KiB

Eager-graph budgets are report-only until a baseline is established. Sizes are gzip of public/**/*.js; eager size is webpack module source bytes for the modules actually shipped in the entrypoint's initial chunks (post-tree-shake).

robbie-c and others added 2 commits August 14, 2026 13:51
The page invited an operator to contact us about load. A robots.txt rule or
one of the other opt-out signals works without waiting on a person, so the
page names those instead and lists the signals the bot reads. It also says
that an opt-out applies to later fetches only.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
The block section already names every method.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

content PR only touches files under contents/ docs Improvements or additions to product documentation, "Docs"

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant