Claim LD07-HQ-C12 (v1.0)
Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol.
Provenance and status
- Claim type
- Fact
- Publication status
- Eligible for publication, with qualifiers: historical snapshot
- Verification state
- Checked against the primary source. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
- Does not license
- Extrapolation of same drift magnitude to all current pinned models; claim open weights solve everything
- Limitations
- 2023 snapshots; provider-specific historical example
- Source (as cited)
- Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024
- Source type
- Peer-reviewed journal article (recorded as “Peer-reviewed journal article”)
- Institutional position
- Academic
- Maturity of the evidence
- Emerging evidence (foundational)
- Recorded date
- 25 September 2026
- Currentness / correction
- This is the current version. No correction or concern is recorded on its sources.
Sources this version cites
- Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?,” Harvard Data Science Review 6(2) (2024) (Peer-reviewed journal article)
Read the original
Version
This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.
This pinned version is also the current version.
Raw record: every recorded field, with its coded values
All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.
- Claim type (coded)
- FACT (as printed: “FACT”)
- Publication status (coded)
- ELIGIBLE (HISTORICAL_SNAPSHOT) (as printed: “ELIGIBLE WITH HISTORICAL-SNAPSHOT QUALIFIER”)
- Verification state (coded)
- CONTENT_VERIFIED_PRIMARY
- Source type (coded)
- PEER_REVIEWED_JOURNAL_ARTICLE
- Maturity (coded)
- EMERGING (FOUNDATIONAL)
| # | Canonical field | Canonical value (verbatim) | Normalized (Claim Value Vocabulary v1.0.2) |
|---|---|---|---|
| 1 | CLAIM ID | LD07-HQ-C12 | — |
| 2 | PUBLIC-FACING CLAIM | Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol. | — |
| 3 | CLAIM TYPE | FACT | base_types: FACT |
| 4 | RESEARCH STRAND | F | — |
| 5 | MATURITY | EMERGING / FOUNDATIONAL | states: EMERGING · qualifiers: FOUNDATIONAL |
| 6 | SOURCE | Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024 | source_ids: SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024 |
| 7 | SOURCE TYPE | Peer-reviewed journal article | classes: PEER_REVIEWED_JOURNAL_ARTICLE |
| 8 | INSTITUTIONAL POSITION | Academic | — |
| 9 | SCOPE | March vs June 2023 GPT-3.5/GPT-4 snapshots | — |
| 10 | DESIGN | Longitudinal service audit across seven task families | — |
| 11 | SAMPLE / DATASET | Math, safety, opinion surveys, knowledge, code, USMLE, visual reasoning | — |
| 12 | MODEL / TOOL / VERSION | GPT-3.5 and GPT-4 March/June 2023 | — |
| 13 | COMPARATOR | Same named services at different dates | — |
| 14 | MAIN RESULT | Material behavior/performance shifts; final HDSR example GPT-4 prime/composite accuracy 84%→51%; willingness on opinion/sensitive questions changed | — |
| 15 | INFERENTIAL TARGET | Reproducibility/non-stationarity | — |
| 16 | DOES NOT LICENSE | Extrapolation of same drift magnitude to all current pinned models; claim open weights solve everything | — |
| 17 | VERIFICATION STATE | CLEARED | state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN |
| 18 | LIMITATIONS | 2023 snapshots; provider-specific historical example | — |
| 19 | CONTRADICTORY / SUPPORTING SOURCES | Later reproducibility literature to update magnitude | — |
| 20 | GEOGRAPHY / LANGUAGE | English task set | — |
| 21 | DISTRIBUTIONAL LEDGER | Not assessed | — |
| 22 | R01 / FIELD-MAP LINKS | T1, T7, R-1, D9 | — |
| 23 | WHAT WOULD CHANGE THIS CLAIM? | Long-term proof that exact proprietary snapshots remain behaviorally stable and archivally accessible | — |
| 24 | PUBLICATION STATUS | ELIGIBLE WITH HISTORICAL-SNAPSHOT QUALIFIER | state: ELIGIBLE · qualifiers: HISTORICAL_SNAPSHOT |
| 25 | RECORDED DATE | 2026-09-25 | — |
Field 22 references resolved against Field Map v0.2: T1 (TENSION); T7 (TENSION); R-1 (LENS); D9 (DOMAIN)
The sources as recorded, with their record IDs and coded source types:
Pinned Sources (field 6, version-specific)
- “Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024” → Chen et al. (2024), “How is ChatGPT’s behavior changing…” (SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0) — Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?,” Harvard Data Science Review 6(2) (2024); class PEER_REVIEWED_JOURNAL_ARTICLE (explicit public provenance pin)
Cited by Living Debate versions
Cite this page
SocioLens project. (2026, September 25). Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol [Claim LD07-HQ-C12, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld07-hq-c12/v1.0/
@misc{sociolens_ld07_hq_c12_v1_0,
author = {{SocioLens project}},
title = {Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol.},
year = {2026},
date = {2026-09-25},
howpublished = {\url{https://sociolens-web.pages.dev/claims/ld07-hq-c12/v1.0/}},
note = {Claim LD07-HQ-C12, version v1.0}
}The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 e9668a837581a16b55aa08d887345c7997aabbe48ece57d6e036cace0cd07d74.
Frozen Drive-derived inputs
- R03 — LD-07 Canonical Claim Ledger v1.0 — LOCKED (v1.0) — Drive ID
1xVz_LrQAA8EA1tPhVWIrDgOUU3Zidlg9; revision: NOT_EXPOSED_BY_DRIVE_TEXT_EXPORT; Drive modified 2026-09-29T04:31:14.120Z; block “ENTRY 12 — LD07-HQ-C12” SHA-2561fc84c068224a516cbd25ebe1523cf72a4a0e56c55866755181ee58e50e3fc1d; SocioLens — Programme Status & Authority Register v0.6 status “CURRENT.”; frozen fixturefixtures/frozen/r03-ld07-claim-ledger-v1.0-canonical.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: Claim version taken from the canonical ledger artifact version (R03 — LD-07 Canonical Claim Ledger v1.0); Implementation Architecture Selection §5
- CURRENT_POINTER = true — basis: SocioLens — Programme Status & Authority Register v0.6 status for "R03 — LD-07 Canonical Claim Ledger v1.0 — LOCKED": "CURRENT."
- FIELD_6_SOURCE_REFERENCE = SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0 — basis: field 6 of ENTRY 12 — LD07-HQ-C12 cites "Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024"; the frozen field-6 segment of this ClaimVersion's ledger block; Drive-derived identity authority (Issue #39 Source inventory): Batch 04 §2; ledger C12 fields 6/7/8; KEY EVIDENCE.
- SOURCE_PROVENANCE_PIN = SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0 — basis: Issue #5 proof rendering (Architecture Proof Protocol v0.1 AP-08 / Amendment v1.2 §6): explicit version-pinned public provenance of this ClaimVersion — the pinned field-6 Source record "Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024"; Drive-derived identity authority (Issue #39 Source inventory): Batch 04 §2; ledger C12 fields 6/7/8; KEY EVIDENCE.