CrawlLedger
Evidence brief · generated from public metadata

Evidence briefs / rslstandard.org

rslstandard.org policy evidence brief.

A bounded report of what CrawlLedger observed, when it observed it, how the versioned parser classified it, and which public hashes identify the retained artifacts.

As of Nov 11, 2026

Generated on request from append-only metadata. Refreshing this page does not crawl the domain.

Executive evidence summary

These counts describe the bounded CrawlLedger record for this domain. They do not establish ownership, intent, crawler identity, compliance, contract, or legal permission.

280observations
3signal types
4parsed changes
Aug 4, 2026first observed

Current observation register

The artifact SHA-256 identifies retained bytes without exposing a private storage location or redistributing the source body.

SignalObservedHTTPStateArtifact SHA-256Parser
llms.txt404Not observed at the expected URL7fc97df768ff9eba81307c6f1f939d4e2c8562dcd36c8c920e7f8e79b8211d98Not applied
robots.txt304Observed; bytes unchanged92f262fba7b443804d16c7270a3aedb521a527625d30e3090a20240fb34b6598robots-rfc9309-rsl-content-signals-0.2.0+agents-2026-09-20
RSL200Observed and parsed3919fdcbe19a927ad606363a76387ca8bf8453ce6a0c9a9b4cc451d981c39670rsl-1.0-errata-2026-07-18-0.2.0

Current robots.txt interpretation

Each state uses the registry and parser version attached to the observation. “Allowed” is a parser result, not a grant or verified crawler behavior.

Tracked crawler observations

These are parser results for the published robots rules, not authentication or legal conclusions.

Crawler tokenObserved stateMatched group
GPTBot
OpenAI · training
allowed*
OAI-SearchBot
OpenAI · search
allowed*
OAI-AdsBot
OpenAI · ads_validation
allowed*
ChatGPT-User
OpenAI · user_action
allowed*
ClaudeBot
Anthropic · training
allowed*
Claude-SearchBot
Anthropic · search
allowed*
Claude-User
Anthropic · user_action
allowed*
Google-Extended
Google · mixed
allowed*
Applebot-Extended
Apple · training
allowed*
PerplexityBot
Perplexity · search
allowed*
Perplexity-User
Perplexity · user_action
allowed*
CCBot
Common Crawl · archive
allowed*

Observed RSL discovery links

Recent append-only timeline

Chain identifiers make replacement or branching detectable. A conditional 304 can extend the chain while reusing the prior artifact hash.

ObservedSignalStateChangedChain hashPrevious chain
RSLObserved and parsedNo095a99a5472ae2803243db1ab66ebbaef58f1d96bb02b7e41c29bed9db1266b31aa106882e025854a498392cb0dcc0613a0095ef0403607d1500ec7df2985191
llms.txtNot observed at the expected URLNo52017ddbb186130a97f3ef57e43fa3ea6808e6c56ba1261c0b932cd6468f621ebb39915212c6b3952cd8bcae2539caaef01390aea8212400036d5ebae1f3c32a
robots.txtObserved; bytes unchangedNoaa28077a77928d2346d569c9d39f29f1d3d37aa3c8ae668188eb66d884bf17e33e33949caf1b7e7385a790339bc2909e79feea36242b322e8483781ff6b90416
RSLObserved; bytes unchangedNo1aa106882e025854a498392cb0dcc0613a0095ef0403607d1500ec7df29851916f5a58b5a6e151662fd064f844bd04380402aff5b3b026d15bfab5f35d0ac8c3
llms.txtNot observed at the expected URLNobb39915212c6b3952cd8bcae2539caaef01390aea8212400036d5ebae1f3c32a8ecea3b507956663d538de961e3f7393604801638bedf13dc959c85deda6248d
robots.txtObserved; bytes unchangedNo3e33949caf1b7e7385a790339bc2909e79feea36242b322e8483781ff6b90416dfc09161a8faec2f913ef08b426a429d8d26a74b391cc630cefaf76e8cd192fc
RSLObserved and parsedYes6f5a58b5a6e151662fd064f844bd04380402aff5b3b026d15bfab5f35d0ac8c368f20a7f77046b233f9407806ea31cd496287dc3c1c9fb6232c37857082119a5
llms.txtNot observed at the expected URLYes8ecea3b507956663d538de961e3f7393604801638bedf13dc959c85deda6248d4ecf24e95c1ca9bb678dda8798e364d66e7a8f21c7b513f3a5391a16c4aa1d74
robots.txtObserved and parsedYesdfc09161a8faec2f913ef08b426a429d8d26a74b391cc630cefaf76e8cd192fc5a7b854710e0a930f3043fe93ab08499cc001e5cb7a8970518d86f8d99be96ac
RSLUnverified after HTTP responseNo68f20a7f77046b233f9407806ea31cd496287dc3c1c9fb6232c37857082119a54825832b801fe100f5035dede5e849b2bfd9e82772211fe6212e6edc1788e492
llms.txtNot observed at the expected URLNo4ecf24e95c1ca9bb678dda8798e364d66e7a8f21c7b513f3a5391a16c4aa1d74798404dddf538e23e31a671c003fd62b6cc23168b63316a59289bcf068ec901e
robots.txtObserved; bytes unchangedNo5a7b854710e0a930f3043fe93ab08499cc001e5cb7a8970518d86f8d99be96ac81c62f4e38caed17cd29ad6c4c5f21900842124f3daec827036fd574e36d4940
RSLUnverified after HTTP responseNo4825832b801fe100f5035dede5e849b2bfd9e82772211fe6212e6edc1788e4927a2ac9abdbef0b3bcecd3f9cb87c860a1674d7884c7594802ace8087fe3b494a
llms.txtNot observed at the expected URLNo798404dddf538e23e31a671c003fd62b6cc23168b63316a59289bcf068ec901e0359805ce9d34bb9a50ac7f3ae0c4201d3dbc22ef16d4bfd2109bb0e8800160d
robots.txtObserved; bytes unchangedNo81c62f4e38caed17cd29ad6c4c5f21900842124f3daec827036fd574e36d494013032f04746fb282f71333280aa73183536a0845bf5e498fe0fad75670347d93
RSLUnverified after HTTP responseNo7a2ac9abdbef0b3bcecd3f9cb87c860a1674d7884c7594802ace8087fe3b494a70ceeef47378cf5656d0c14354c2ffccbd1b19b09ac557fe90b66b02c4c86452
llms.txtNot observed at the expected URLNo0359805ce9d34bb9a50ac7f3ae0c4201d3dbc22ef16d4bfd2109bb0e8800160d5809d06e7d21e80da3c07fcf09a25cf46991edf9e17e86bd4f47f5f97d090965
robots.txtObserved; bytes unchangedNo13032f04746fb282f71333280aa73183536a0845bf5e498fe0fad75670347d93375532564b236201fd781ac93ba1d861e8c19fdeebe1b15d236b8934ae26dee6
RSLUnverified after HTTP responseNo70ceeef47378cf5656d0c14354c2ffccbd1b19b09ac557fe90b66b02c4c864525a9b4bbbbc78f15b77df1ddb023107b42143daaab379cdc21f033f3f3e3f5397
llms.txtNot observed at the expected URLNo5809d06e7d21e80da3c07fcf09a25cf46991edf9e17e86bd4f47f5f97d090965f478d22a8b374013e7e9188e9ef66700ff6f80a08b9e353da9cacaa3808cdad9

Method and limitations

CrawlLedger observes narrow public policy endpoints, records bounded response metadata, retains source bytes privately by content hash, and appends parser output. It does not authenticate requesting bots, infer unstated intent, or decide legal permission.

Included

Public metadata, exact hashes, parser versions, signal states, and recent chain links from the fixed cohort.

Not included

Private artifact keys, raw source redistribution, ordinary page content, legal conclusions, or customer-specific monitoring.

How this report was produced: CrawlLedger assembled it automatically from append-only observation metadata and a versioned parser registry. Documentation and product boundaries were source-reviewed on Sep 20, 2026. No new network fetch, customer data, or legal interpretation was added for this export.