Claim LD08-SL-C17 (v1.0)
Anthropic’s first Economic Index report classified Claude conversations as 57% augmentation and 43% automation; the classifications were made by Claude and checked by the authors on 150 hand-validated conversations drawn from those for which users had submitted feedback, with 90.7% agreement on the augmentation–automation label and 86% to 95.3% acceptable task assignments by level of detail.
Research opportunities this claim motivates
What this claim leaves open for research. Each is a hypothesis about a gap, not a finding.
- Do developers' usage statistics hold up when someone else classifies the conversations?Classifications made by the developer's model and checked on 150 conversations chosen from those with user feedback.
Provenance and status
- Claim type
- Estimate
- Publication status
- Eligible for publication, with qualifiers: source position
- Verification state
- Checked against the primary source; the source is a preprint. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
- Does not license
- A description of AI use in general or on other platforms, which the authors say may differ
- Limitations
- Read in arXiv version 1; validation sample drawn from feedback conversations, which may not represent all use; data are 7-day snapshots; one platform; the authors say the true augmentation share may be even higher and list these limits themselves
- Source (as cited)
- Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025
- Source type
- Preprint (recorded as “Preprint”)
- Institutional position
- AI developer self-report (Anthropic, the developer of the model that drafted this debate)
- Maturity of the evidence
- Emerging evidence
- Recorded date
- 16 October 2026
- Currentness / correction
- This is the current version. No correction or concern is recorded on its sources.
Sources this version cites
Version
This is the current version, v1.0. Earlier versions stay available, and their records never change.
Raw record: every recorded field, with its coded values
All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.
- Claim type (coded)
- ESTIMATE (as printed: “ESTIMATE”)
- Publication status (coded)
- ELIGIBLE (SOURCE_POSITION) (as printed: “ELIGIBLE WITH SOURCE-POSITION QUALIFIER”)
- Verification state (coded)
- CONTENT_VERIFIED_PRIMARY (PREPRINT)
- Source type (coded)
- PREPRINT
- Maturity (coded)
- EMERGING
| # | Canonical field | Canonical value (verbatim) | Normalized (Claim Value Vocabulary v1.0.2) |
|---|---|---|---|
| 1 | CLAIM ID | LD08-SL-C17 | — |
| 2 | PUBLIC-FACING CLAIM | Anthropic’s first Economic Index report classified Claude conversations as 57% augmentation and 43% automation; the classifications were made by Claude and checked by the authors on 150 hand-validated conversations drawn from those for which users had submitted feedback, with 90.7% agreement on the augmentation–automation label and 86% to 95.3% acceptable task assignments by level of detail. | — |
| 3 | CLAIM TYPE | ESTIMATE | base_types: ESTIMATE |
| 4 | RESEARCH STRAND | B — Data and access | — |
| 5 | MATURITY | EMERGING | states: EMERGING |
| 6 | SOURCE | Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025 | source_ids: SRC-SL-HANDA-ET-AL-ARXIV-2503-04761 |
| 7 | SOURCE TYPE | Preprint | classes: PREPRINT |
| 8 | INSTITUTIONAL POSITION | AI developer self-report (Anthropic, the developer of the model that drafted this debate) | — |
| 9 | SCOPE | Claude.ai Free and Pro conversations, December 2024 to January 2025 | — |
| 10 | DESIGN | Model-based mapping of conversations to occupational tasks (O*NET) and to modes of collaboration | — |
| 11 | SAMPLE / DATASET | Over 4 million conversations; 150 hand-validated examples per classification | — |
| 12 | MODEL / TOOL / VERSION | Claude models, via Clio | — |
| 13 | COMPARATOR | Not applicable | — |
| 14 | MAIN RESULT | 57% augmentation, 43% automation; about 36% of occupations use AI for at least a quarter of their tasks; validation 95.3% (top level), 91.3% (middle), 86% (task level); 90.7% for the automation–augmentation label | — |
| 15 | INFERENTIAL TARGET | What tasks people use one developer’s AI system for | — |
| 16 | DOES NOT LICENSE | A description of AI use in general or on other platforms, which the authors say may differ | — |
| 17 | VERIFICATION STATE | CONTENT VERIFIED PREPRINT | state: CONTENT_VERIFIED_PRIMARY · qualifiers: PREPRINT · verified_by: UNKNOWN |
| 18 | LIMITATIONS | Read in arXiv version 1; validation sample drawn from feedback conversations, which may not represent all use; data are 7-day snapshots; one platform; the authors say the true augmentation share may be even higher and list these limits themselves | — |
| 19 | CONTRADICTORY / SUPPORTING SOURCES | LD08-SL-C18; LD08-SL-C21 | — |
| 20 | GEOGRAPHY / LANGUAGE | Global platform / English | — |
| 21 | DISTRIBUTIONAL LEDGER | Occupational coverage is uneven; O*NET is US-centric | — |
| 22 | R01 / FIELD-MAP LINKS | LD-08, D3, D2 | — |
| 23 | WHAT WOULD CHANGE THIS CLAIM? | An independent re-classification of comparable conversation data | — |
| 24 | PUBLICATION STATUS | ELIGIBLE WITH SOURCE-POSITION QUALIFIER | state: ELIGIBLE · qualifiers: SOURCE_POSITION |
| 25 | RECORDED DATE | 2026-10-16 | — |
Field 22 references resolved against Field Map v0.2: LD-08 (LIVING_DEBATE); D3 (DOMAIN); D2 (DOMAIN)
The sources as recorded, with their record IDs and coded source types:
Pinned Sources (field 6, version-specific)
- “Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025” → Handa et al. (2025), “Which Economic Tasks are Performed…” (SRC-SL-HANDA-ET-AL-ARXIV-2503-04761--v1.0) — Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025; class PREPRINT (explicit public provenance pin)
Cited by Living Debate versions
Cite this page
SocioLens project. (2026, October 16). Anthropic’s first Economic Index report classified Claude conversations as 57% augmentation and 43% automation; the classifications were made by Claude and checked by the authors on 150 hand-validated conversations drawn from those for which users had submitted feedback, with 90.7% agreement on the augmentation–automation label and 86% to 95.3% acceptable task assignments by level of detail [Claim LD08-SL-C17, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld08-sl-c17/v1.0/
@misc{sociolens_ld08_sl_c17_v1_0,
author = {{SocioLens project}},
title = {Anthropic’s first Economic Index report classified Claude conversations as 57\% augmentation and 43\% automation; the classifications were made by Claude and checked by the authors on 150 hand-validated conversations drawn from those for which users had submitted feedback, with 90.7\% agreement on the augmentation–automation label and 86\% to 95.3\% acceptable task assignments by level of detail.},
year = {2026},
date = {2026-10-16},
howpublished = {\url{https://sociolens-web.pages.dev/claims/ld08-sl-c17/v1.0/}},
note = {Claim LD08-SL-C17, version v1.0}
}The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 769e196321944f0badbf6b24fe45b3d157fab479a06596e470aa860e0a07e98a.
Repository-authored inputs (not Drive exports)
- SocioLens claim — LD08-SL-C17 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-16; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-08 debate; a new Claim, first version, written from the project's LD-08 source notes, checked against full texts, official web pages or official abstracts. Block “ENTRY 17 — LD08-SL-C17” SHA-256
8fd5ec132c2b774aee790caf718c961366aec8ea783126230aed21ddb6dcbb60; fixturefixtures/authored/claims/LD08-SL-C17--v1.0.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD08-SL-C17 v1.0); the first version of a new Claim of the LD-08 debate
- CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD08-SL-C17 v1.0" (Project Lead (Claude, AI), 2026-10-16); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-08 debate; a new Claim, first version, written from the project's LD-08 source notes, checked against full texts, official web pages or official abstracts
- FIELD_6_SOURCE_REFERENCE = SRC-SL-HANDA-ET-AL-ARXIV-2503-04761--v1.0 — basis: field 6 of ENTRY 17 — LD08-SL-C17 cites "Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
- SOURCE_PROVENANCE_PIN = SRC-SL-HANDA-ET-AL-ARXIV-2503-04761--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Handa, Tamkin, McCain, Huang, Durmus et al., “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations,” arXiv:2503.04761, 2025".