CrawlLedger
Evidence brief · generated from public metadata

Evidence briefs / rslstandard.org

rslstandard.org policy evidence brief.

A bounded report of what CrawlLedger observed, when it observed it, how the versioned parser classified it, and which public hashes identify the retained artifacts.

As of Sep 23, 2026

Generated on request from append-only metadata. Refreshing this page does not crawl the domain.

Executive evidence summary

These counts describe the bounded CrawlLedger record for this domain. They do not establish ownership, intent, crawler identity, compliance, contract, or legal permission.

135observations
3signal types
0parsed changes
Aug 4, 2026first observed

Current observation register

The artifact SHA-256 identifies retained bytes without exposing a private storage location or redistributing the source body.

SignalObservedHTTPStateArtifact SHA-256Parser
llms.txt404Not observed at the expected URLe56d580b800a0b58d61103e1623612678945d0bb20cba49b8cdec87dca63f94cNot applied
robots.txt304Observed; bytes unchangeda311664af7888b7f548097fb479feec292f4a5e3cc99f2e9b567f7641108e162robots-rfc9309-rsl-content-signals-0.2.0
RSL304Observed; bytes unchangeda351dca7a4400cde9a2182dfa2ffcb1d1ed9ab989736a69c14d2f763780ade54rsl-1.0-errata-2026-07-18-0.2.0

Current robots.txt interpretation

Each state uses the registry and parser version attached to the observation. “Allowed” is a parser result, not a grant or verified crawler behavior.

Tracked crawler observations

These are parser results for the published robots rules, not authentication or legal conclusions.

Crawler tokenObserved stateMatched group
GPTBot
OpenAI · training
allowed*
OAI-SearchBot
OpenAI · search
allowed*
OAI-AdsBot
OpenAI · ads_validation
unverifiedNo matching group observed
ChatGPT-User
OpenAI · user_action
allowed*
ClaudeBot
Anthropic · training
allowed*
Claude-SearchBot
Anthropic · search
allowed*
Claude-User
Anthropic · user_action
allowed*
Google-Extended
Google · mixed
allowed*
Applebot-Extended
Apple · training
allowed*
PerplexityBot
Perplexity · search
allowed*
Perplexity-User
Perplexity · user_action
allowed*
CCBot
Common Crawl · archive
allowed*

Observed RSL discovery links

Recent append-only timeline

Chain identifiers make replacement or branching detectable. A conditional 304 can extend the chain while reusing the prior artifact hash.

ObservedSignalStateChangedChain hashPrevious chain
RSLObserved; bytes unchangedNoddaaf6f688d040e49a24f1604a8e8fde509ab9d3dbc911789c84ddd806a1f7edaac887cbcf7d3f9a87138dfae7e9b2e057130c60fa18c2fb3d81c1e63db41c2c
llms.txtNot observed at the expected URLNo965e0f229ef07d1810fc8d3c4b1f4951614e1a9dd1315b13498851d3046cfe7881e75f9aab24812a3a60df4916ccf4da1f1546b914e66553602c9bc32951fd72
robots.txtObserved; bytes unchangedNod8e47addba5431ac5686cfe7ff4302d876142349632cf24ec48378ab35206d254095e3ffdde0b854cac1ca5c6be167b436e9c5b79f875b11a76f1d11ab404a8d
RSLObserved and parsedNoaac887cbcf7d3f9a87138dfae7e9b2e057130c60fa18c2fb3d81c1e63db41c2c942b4f6f9957e32c3f366b0522d4bb03294827037efb88bcc6508421de0da8dd
llms.txtNot observed at the expected URLNo81e75f9aab24812a3a60df4916ccf4da1f1546b914e66553602c9bc32951fd72d05c786d95fed156fba7d1cfe384cb168f14d1d486b9d642faec44c06a8c139c
robots.txtObserved; bytes unchangedNo4095e3ffdde0b854cac1ca5c6be167b436e9c5b79f875b11a76f1d11ab404a8d41d0a8986860559197f9b73297b6d6c24f15c968994a14addda6559800dceffb
RSLObserved; bytes unchangedNo942b4f6f9957e32c3f366b0522d4bb03294827037efb88bcc6508421de0da8ddfdf524c95bb38b227f15f87f412e12d800674621c05d23bde36643cb744627e5
llms.txtNot observed at the expected URLNod05c786d95fed156fba7d1cfe384cb168f14d1d486b9d642faec44c06a8c139c0b2b4084570f297f743f671682d29825733570fc6ae626220a8e7a73404f6c36
robots.txtObserved; bytes unchangedNo41d0a8986860559197f9b73297b6d6c24f15c968994a14addda6559800dceffb15d4e152c61c110c732b4758009cae3a9fa2dd3d41792c13117fa72daa645bc3
RSLObserved and parsedNofdf524c95bb38b227f15f87f412e12d800674621c05d23bde36643cb744627e572033f2ce75794e9f2376bd9bc062b1b97c3a7ce70ef0390a68cd55cdd6181f1
llms.txtNot observed at the expected URLNo0b2b4084570f297f743f671682d29825733570fc6ae626220a8e7a73404f6c36714eeb91d0abbc99fadf8ac338a7a5983d596e56822a9d6d8480e18c9244e468
robots.txtObserved; bytes unchangedNo15d4e152c61c110c732b4758009cae3a9fa2dd3d41792c13117fa72daa645bc3d307a92cf2def357283d7cbdf5d126cce1f5b86eebb03ddc7725fd94118dfc8b
RSLObserved; bytes unchangedNo72033f2ce75794e9f2376bd9bc062b1b97c3a7ce70ef0390a68cd55cdd6181f1676098b2e63016bde85413a2302a498f7847a0285bb9beef011de6ab48d8f144
llms.txtNot observed at the expected URLNo714eeb91d0abbc99fadf8ac338a7a5983d596e56822a9d6d8480e18c9244e468f696078d6efe9542df5f16e31e3ab10401ffd650e07ad78e2b91a9ba431f54bd
robots.txtObserved; bytes unchangedNod307a92cf2def357283d7cbdf5d126cce1f5b86eebb03ddc7725fd94118dfc8b3489ea2dd956a5679804750da21b3e2004c66f581e74ff02b4f0addea6c8524c
RSLObserved and parsedNo676098b2e63016bde85413a2302a498f7847a0285bb9beef011de6ab48d8f1446833959c6d4a262a6d53257e836d62044a38e3a06c5eee7fa31eefc0059352d7
llms.txtNot observed at the expected URLNof696078d6efe9542df5f16e31e3ab10401ffd650e07ad78e2b91a9ba431f54bda31ed932d5fd10252213f39a986f145fa45b800cc3c1fb85c9b45b9ecf18c08c
robots.txtObserved; bytes unchangedNo3489ea2dd956a5679804750da21b3e2004c66f581e74ff02b4f0addea6c8524c80538555fd3151342f65ccf23f01524707c469235829e604e6e1268317720ea7
RSLObserved; bytes unchangedNo6833959c6d4a262a6d53257e836d62044a38e3a06c5eee7fa31eefc0059352d79e99f797f58ae34d13d9846f24c36d00521092fb51ddaa61dbd74a1aac858f59
llms.txtNot observed at the expected URLNoa31ed932d5fd10252213f39a986f145fa45b800cc3c1fb85c9b45b9ecf18c08cf6136d5fb6dbf67604780d7ab3ddaa0e01ae1013b63e9aad8aebfaea26f6bd2b

Method and limitations

CrawlLedger observes narrow public policy endpoints, records bounded response metadata, retains source bytes privately by content hash, and appends parser output. It does not authenticate requesting bots, infer unstated intent, or decide legal permission.

Included

Public metadata, exact hashes, parser versions, signal states, and recent chain links from the fixed cohort.

Not included

Private artifact keys, raw source redistribution, ordinary page content, legal conclusions, or customer-specific monitoring.

How this report was produced: CrawlLedger assembled it automatically from append-only observation metadata and a versioned parser registry. Documentation and product boundaries were source-reviewed on Sep 20, 2026. No new network fetch, customer data, or legal interpretation was added for this export.