CrawlLedger
Evidence brief · generated from public metadata

Evidence briefs / rslcollective.org

rslcollective.org policy evidence brief.

A bounded report of what CrawlLedger observed, when it observed it, how the versioned parser classified it, and which public hashes identify the retained artifacts.

As of Nov 11, 2026

Generated on request from append-only metadata. Refreshing this page does not crawl the domain.

Executive evidence summary

These counts describe the bounded CrawlLedger record for this domain. They do not establish ownership, intent, crawler identity, compliance, contract, or legal permission.

355observations
3signal types
4parsed changes
Aug 4, 2026first observed

Current observation register

The artifact SHA-256 identifies retained bytes without exposing a private storage location or redistributing the source body.

SignalObservedHTTPStateArtifact SHA-256Parser
llms.txt404Not observed at the expected URLeff1827162323927a35fc7647683af7c802733e10cd701ff19bae6a853403286Not applied
robots.txt304Observed; bytes unchangedf90013084c5c409656b23ae2113d0cdd1bade55961e1fccba9eb1490f5da9bbdrobots-rfc9309-rsl-content-signals-0.2.0+agents-2026-09-20
RSL304Observed; bytes unchanged8510cbb2a6e4cddcdb98d424641629cf2d71a05ef71c9ff271b2c1ead6b46495rsl-1.0-errata-2026-07-18-0.2.0

Current robots.txt interpretation

Each state uses the registry and parser version attached to the observation. “Allowed” is a parser result, not a grant or verified crawler behavior.

Tracked crawler observations

These are parser results for the published robots rules, not authentication or legal conclusions.

Crawler tokenObserved stateMatched group
GPTBot
OpenAI · training
allowed*
OAI-SearchBot
OpenAI · search
allowed*
OAI-AdsBot
OpenAI · ads_validation
allowed*
ChatGPT-User
OpenAI · user_action
allowed*
ClaudeBot
Anthropic · training
allowed*
Claude-SearchBot
Anthropic · search
allowed*
Claude-User
Anthropic · user_action
allowed*
Google-Extended
Google · mixed
allowed*
Applebot-Extended
Apple · training
allowed*
PerplexityBot
Perplexity · search
allowed*
Perplexity-User
Perplexity · user_action
allowed*
CCBot
Common Crawl · archive
allowed*

Observed RSL discovery links

Recent append-only timeline

Chain identifiers make replacement or branching detectable. A conditional 304 can extend the chain while reusing the prior artifact hash.

ObservedSignalStateChangedChain hashPrevious chain
RSLObserved; bytes unchangedNo8ec8771d1ce1f2d9808b8ddebee983b05b2fe3488183c29d6a69893c95b86dcb356bd6dd3833a2dd94df31a04d9a157efee967e74ba8196113e084dbf3916115
llms.txtNot observed at the expected URLNoa22308430fd3722cc1be182d2b5617b6edce01339e5a11bd078a79be61d8fa68d77204846109a1370fc1966b6c5e532af34f01a5f6c9d31515a79ac3d16d78b2
robots.txtObserved; bytes unchangedNoe127d9adf5585b74d58371d927f8c66bdfa8b0560cc7a549b80f63f31023f1cd5047a769e992530b5a2adce104a0d44c7f77b70f4605b7f175c98c954dbf625e
RSLObserved and parsedNo356bd6dd3833a2dd94df31a04d9a157efee967e74ba8196113e084dbf39161157b6922adce165cf14a72a5d8dc4394f8f6c520cf335e0f9bf9720ed20615ceea
llms.txtNot observed at the expected URLNod77204846109a1370fc1966b6c5e532af34f01a5f6c9d31515a79ac3d16d78b2ff2f348ff1386e068d13d5be382729e233df76b40667ed865b95b578c95f1d03
robots.txtObserved; bytes unchangedNo5047a769e992530b5a2adce104a0d44c7f77b70f4605b7f175c98c954dbf625e891de1ac024b1950606243ad253cd1d444b3bc745ec4edd568a41c06587d10b9
RSLObserved; bytes unchangedNo7b6922adce165cf14a72a5d8dc4394f8f6c520cf335e0f9bf9720ed20615ceeabbdde90023641dbdbfbf381bb625e0e58a72f79aefd57500a516be539f9e698a
llms.txtNot observed at the expected URLNoff2f348ff1386e068d13d5be382729e233df76b40667ed865b95b578c95f1d03cafdc6b1a3d009d707d7b529334f2984c0f12064f979e02569babab6bd126e59
robots.txtObserved; bytes unchangedNo891de1ac024b1950606243ad253cd1d444b3bc745ec4edd568a41c06587d10b97c8f01f70e7ba9e45d9a891c10a0950a726ea7720841e4ec18825233270d766a
RSLObserved and parsedNobbdde90023641dbdbfbf381bb625e0e58a72f79aefd57500a516be539f9e698a3b348090a58c5f104f47f105e796a1c2cbb4eb5d0b784cdf037db693c2059484
llms.txtNot observed at the expected URLNocafdc6b1a3d009d707d7b529334f2984c0f12064f979e02569babab6bd126e599d5550326475cb811819d053645fc98a70ce33c065b5e21d9bfff601217dd9b1
robots.txtObserved; bytes unchangedNo7c8f01f70e7ba9e45d9a891c10a0950a726ea7720841e4ec18825233270d766affbb7b8e6b5b322e9397868cc8c0c23738824fe1f408168cb850a660a949f4eb
RSLObserved; bytes unchangedNo3b348090a58c5f104f47f105e796a1c2cbb4eb5d0b784cdf037db693c205948400fa4b736194138595a3d3c8abc901bc1d39ad9114a38b88853323d16bb72942
llms.txtNot observed at the expected URLNo9d5550326475cb811819d053645fc98a70ce33c065b5e21d9bfff601217dd9b183eefc0e59785d371921d32f612bf70f8394d26d93dd52858d4b3d281676743e
robots.txtObserved; bytes unchangedNoffbb7b8e6b5b322e9397868cc8c0c23738824fe1f408168cb850a660a949f4eb3b388bd53f1c29c7f276cb4b400fde864479576bd8dca23414d061498c905d63
RSLObserved and parsedNo00fa4b736194138595a3d3c8abc901bc1d39ad9114a38b88853323d16bb729429170185afe338060b158fab8adc1fcc2906ed2a99e3ca8739c7d2b049fac16b6
llms.txtNot observed at the expected URLNo83eefc0e59785d371921d32f612bf70f8394d26d93dd52858d4b3d281676743e52a48dfa83e8da65b29e43e82e40ee388ef9ad215fb3eff3644943db88c06f11
robots.txtObserved; bytes unchangedNo3b388bd53f1c29c7f276cb4b400fde864479576bd8dca23414d061498c905d6378a07dfd7f8d8cda903b19dfa5d74749521041a0c45fbf71fce38d465b883b6c
RSLObserved; bytes unchangedNo9170185afe338060b158fab8adc1fcc2906ed2a99e3ca8739c7d2b049fac16b6ff0b98f31dcb2bd7fff89020fd19dada17eed4e3270cc18f47048748a74cee5f
llms.txtNot observed at the expected URLNo52a48dfa83e8da65b29e43e82e40ee388ef9ad215fb3eff3644943db88c06f11896b89f234041bbe743110e1c0d24b6b0f925eed2e561de315fc7e04e20ab70f

Method and limitations

CrawlLedger observes narrow public policy endpoints, records bounded response metadata, retains source bytes privately by content hash, and appends parser output. It does not authenticate requesting bots, infer unstated intent, or decide legal permission.

Included

Public metadata, exact hashes, parser versions, signal states, and recent chain links from the fixed cohort.

Not included

Private artifact keys, raw source redistribution, ordinary page content, legal conclusions, or customer-specific monitoring.

How this report was produced: CrawlLedger assembled it automatically from append-only observation metadata and a versioned parser registry. Documentation and product boundaries were source-reviewed on Sep 20, 2026. No new network fetch, customer data, or legal interpretation was added for this export.