In its September 2025 Economic Index report, Anthropic reported that the share of automation in Claude.ai conversations depended in part on which model did the classifying: re-running the same August 2025 data with Claude Sonnet 3.7 instead of Claude Sonnet 4 gave 45% automation instead of 49%, though the rise in directive use remained.

SocioLens project,

Claim LD08-SL-C18 (v1.0)

Research opportunities this claim motivates

What this claim leaves open for research. Each is a hypothesis about a gap, not a finding.

Do developers' usage statistics hold up when someone else classifies the conversations?The automation share moved from 49% to 45% when another model classified the same conversations.

Provenance and status

Claim type: Fact
Publication status: Eligible for publication, with qualifiers: source position
Verification state: Checked against the primary source. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
Does not license: A judgement on which classification is correct
Limitations: Read on the web page as served on 16 October 2026; the comparison is in a footnote, which also reports that the shift is not driven by task mix; the report does not say how large other model-driven differences are
Source (as cited): Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025
Source type: Vendor or company document (recorded as “AI developer research report”)
Institutional position: AI developer self-report (Anthropic, the developer of the model that drafted this debate)
Maturity of the evidence: Emerging evidence
Recorded date: 16 October 2026
Currentness / correction: This is the current version. No correction or concern is recorded on its sources.

Sources this version cites

Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025 (Vendor or company document)
Read the original

Version

This is the current version, v1.0. Earlier versions stay available, and their records never change.

Versions: v1.0 · current

Raw record: every recorded field, with its coded values

All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.

Claim type (coded): FACT (as printed: “FACT”)
Publication status (coded): ELIGIBLE (SOURCE_POSITION) (as printed: “ELIGIBLE WITH SOURCE-POSITION QUALIFIER”)
Verification state (coded): CONTENT_VERIFIED_PRIMARY
Source type (coded): VENDOR_PRIMARY
Maturity (coded): EMERGING

#	Canonical field	Canonical value (verbatim)	Normalized (Claim Value Vocabulary v1.0.2)
1	CLAIM ID	LD08-SL-C18	—
2	PUBLIC-FACING CLAIM	In its September 2025 Economic Index report, Anthropic reported that the share of automation in Claude.ai conversations depended in part on which model did the classifying: re-running the same August 2025 data with Claude Sonnet 3.7 instead of Claude Sonnet 4 gave 45% automation instead of 49%, though the rise in directive use remained.	—
3	CLAIM TYPE	FACT	base_types: FACT
4	RESEARCH STRAND	B — Data and access	—
5	MATURITY	EMERGING	states: EMERGING
6	SOURCE	Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025	source_ids: SRC-SL-ANTHROPIC-ECONOMIC-INDEX-2025-09-15
7	SOURCE TYPE	AI developer research report	classes: VENDOR_PRIMARY
8	INSTITUTIONAL POSITION	AI developer self-report (Anthropic, the developer of the model that drafted this debate)	—
9	SCOPE	Claude.ai conversations and first-party API transcripts, August 2025	—
10	DESIGN	Model-based classification of conversations; comparison with earlier reports	—
11	SAMPLE / DATASET	1 million Claude.ai conversations and 1 million API transcripts; the re-run covers Claude.ai data	—
12	MODEL / TOOL / VERSION	Claude Sonnet 4 (this report) and Claude Sonnet 3.7 (the previous report and the re-run)	—
13	COMPARATOR	The same data classified by the earlier model	—
14	MAIN RESULT	Automation 49% with Sonnet 4 and 45% with Sonnet 3.7 on the same data; directive conversations rose from 27% to 39% across reports	—
15	INFERENTIAL TARGET	How far one developer’s usage statistics depend on its own measuring model	—
16	DOES NOT LICENSE	A judgement on which classification is correct	—
17	VERIFICATION STATE	CONTENT VERIFIED	state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN
18	LIMITATIONS	Read on the web page as served on 16 October 2026; the comparison is in a footnote, which also reports that the shift is not driven by task mix; the report does not say how large other model-driven differences are	—
19	CONTRADICTORY / SUPPORTING SOURCES	LD08-SL-C17; LD08-SL-C19	—
20	GEOGRAPHY / LANGUAGE	Global platform / English	—
21	DISTRIBUTIONAL LEDGER	Geographic breakdowns cover Claude.ai only	—
22	R01 / FIELD-MAP LINKS	LD-08, D3	—
23	WHAT WOULD CHANGE THIS CLAIM?	An independent re-classification of the same data	—
24	PUBLICATION STATUS	ELIGIBLE WITH SOURCE-POSITION QUALIFIER	state: ELIGIBLE · qualifiers: SOURCE_POSITION
25	RECORDED DATE	2026-10-16	—

Field 22 references resolved against Field Map v0.2: LD-08 (LIVING_DEBATE); D3 (DOMAIN)

The sources as recorded, with their record IDs and coded source types:

Pinned Sources (field 6, version-specific)

“Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025” → Anthropic (2025), “Anthropic Economic Index report…” (SRC-SL-ANTHROPIC-ECONOMIC-INDEX-2025-09-15--v1.0) — Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025; class VENDOR_PRIMARY (explicit public provenance pin)

Cited by Living Debate versions

Who can know about AI? Epistemic dependence and jurisdiction over the field (v0.1) LD-08

Cite this page

SocioLens project. (2026, October 16). In its September 2025 Economic Index report, Anthropic reported that the share of automation in Claude.ai conversations depended in part on which model did the classifying: re-running the same August 2025 data with Claude Sonnet 3.7 instead of Claude Sonnet 4 gave 45% automation instead of 49%, though the rise in directive use remained [Claim LD08-SL-C18, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld08-sl-c18/v1.0/

@misc{sociolens_ld08_sl_c18_v1_0,
  author = {{SocioLens project}},
  title = {In its September 2025 Economic Index report, Anthropic reported that the share of automation in Claude.ai conversations depended in part on which model did the classifying: re-running the same August 2025 data with Claude Sonnet 3.7 instead of Claude Sonnet 4 gave 45\% automation instead of 49\%, though the rise in directive use remained.},
  year = {2026},
  date = {2026-10-16},
  howpublished = {\url{https://sociolens-web.pages.dev/claims/ld08-sl-c18/v1.0/}},
  note = {Claim LD08-SL-C18, version v1.0}
}

The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 8a1f815752cff8c7c719cea75dd474240d4083f59193704ce3050a179afa91d1.

Repository-authored inputs (not Drive exports)

SocioLens claim — LD08-SL-C18 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-16; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-08 debate; a new Claim, first version, written from the project's LD-08 source notes, checked against full texts, official web pages or official abstracts. Block “ENTRY 18 — LD08-SL-C18” SHA-256 131c00ff7d048f9af9449689f5ae02cfc7ab68f3d76dc1399b052dff421eb1ec; fixture fixtures/authored/claims/LD08-SL-C18--v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD08-SL-C18 v1.0); the first version of a new Claim of the LD-08 debate
CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD08-SL-C18 v1.0" (Project Lead (Claude, AI), 2026-10-16); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-08 debate; a new Claim, first version, written from the project's LD-08 source notes, checked against full texts, official web pages or official abstracts
FIELD_6_SOURCE_REFERENCE = SRC-SL-ANTHROPIC-ECONOMIC-INDEX-2025-09-15--v1.0 — basis: field 6 of ENTRY 18 — LD08-SL-C18 cites "Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
SOURCE_PROVENANCE_PIN = SRC-SL-ANTHROPIC-ECONOMIC-INDEX-2025-09-15--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Anthropic, “Anthropic Economic Index report: Uneven geographic and enterprise AI adoption,” 15 September 2025".