Preview: not announced. Search engines asked not to index.

Claim LD06-SL-C02 (v1.0)

The 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report”.

Provenance and status

Claim type
Fact
Publication status
Eligible for publication, with a qualifier
Verification state
Checked against the primary source. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
Does not license
A claim that any particular company-reported score is wrong, or how many of the index’s figures are company-reported
Limitations
Covers one chapter of one edition; the share of the chapter’s scores that are company-reported was not counted
Source (as cited)
Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026
Source type
Independent research report (recorded as “Annual index report”)
Institutional position
University-based index (Stanford HAI)
Maturity of the evidence
Mature evidence
Recorded date
15 October 2026
Currentness / correction
This is the current version. No correction or concern is recorded on its sources.

Sources this version cites

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

This pinned version is also the current version.

Versions: v1.0 · current

Raw record: every recorded field, with its coded values

All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.

Claim type (coded)
FACT (as printed: “FACT”)
Publication status (coded)
ELIGIBLE (QUALIFIED) (as printed: “ELIGIBLE WITH QUALIFIER”)
Verification state (coded)
CONTENT_VERIFIED_PRIMARY
Source type (coded)
INDEPENDENT_RESEARCH_REPORT
Maturity (coded)
MATURE
#Canonical fieldCanonical value (verbatim)Normalized (Claim Value Vocabulary v1.0.2)
1CLAIM IDLD06-SL-C02—
2PUBLIC-FACING CLAIMThe 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report”.—
3CLAIM TYPEFACTbase_types: FACT
4RESEARCH STRANDB — Leaderboards, judges and disclosure—
5MATURITYMATUREstates: MATURE
6SOURCESajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026source_ids: SRC-SL-AI-INDEX-2026-ANNUAL-REPORT
7SOURCE TYPEAnnual index reportclasses: INDEPENDENT_RESEARCH_REPORT
8INSTITUTIONAL POSITIONUniversity-based index (Stanford HAI)—
9SCOPEThe technical-performance chapter of the 2026 report—
10DESIGNStatement of method in the report—
11SAMPLE / DATASETBenchmark scores reported as of early 2026—
12MODEL / TOOL / VERSIONNot applicable—
13COMPARATORNone—
14MAIN RESULT“Scores are sourced from leaderboards, public repositories, and company disclosures, including papers, blog posts, and product releases. The AI Index assumes that company-reported results are accurate.”—
15INFERENTIAL TARGETWhether a widely relayed index verifies developers’ own benchmark scores—
16DOES NOT LICENSEA claim that any particular company-reported score is wrong, or how many of the index’s figures are company-reported—
17VERIFICATION STATECONTENT VERIFIEDstate: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN
18LIMITATIONSCovers one chapter of one edition; the share of the chapter’s scores that are company-reported was not counted—
19CONTRADICTORY / SUPPORTING SOURCESThe same chapter notes cases where models did worse in independent testing than developers reported; on falling developer disclosure, LD06-SL-C17—
20GEOGRAPHY / LANGUAGEGlobal / English—
21DISTRIBUTIONAL LEDGERNot analysed in this claim—
22R01 / FIELD-MAP LINKSLD-06, D4b—
23WHAT WOULD CHANGE THIS CLAIM?A later edition that verifies or marks company-reported scores—
24PUBLICATION STATUSELIGIBLE WITH QUALIFIERstate: ELIGIBLE · qualifiers: QUALIFIED
25RECORDED DATE2026-10-15—

Field 22 references resolved against Field Map v0.2: LD-06 (LIVING_DEBATE); D4b (SUB_AREA)

The sources as recorded, with their record IDs and coded source types:

Pinned Sources (field 6, version-specific)

  • “Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026” → Sajadieh et al. (2026), “The AI Index 2026 Annual Report” (SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0) — Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026; class INDEPENDENT_RESEARCH_REPORT (explicit public provenance pin)

Cited by Living Debate versions

Cite this page

SocioLens project. (2026, October 15). The 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report” [Claim LD06-SL-C02, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld06-sl-c02/v1.0/

@misc{sociolens_ld06_sl_c02_v1_0,
  author = {{SocioLens project}},
  title = {The 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report”.},
  year = {2026},
  date = {2026-10-15},
  howpublished = {\url{https://sociolens-web.pages.dev/claims/ld06-sl-c02/v1.0/}},
  note = {Claim LD06-SL-C02, version v1.0}
}

The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 71df6b9d2e0d21c7fee35bdee5658618c93d543cca072dbd8847035e832b0bfd.

Repository-authored inputs (not Drive exports)

  • SocioLens claim — LD06-SL-C02 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 02 — LD06-SL-C02” SHA-256 95f35a5f492872212587a230dd97f5366f59551642b1624492acaea7ab2959da; fixture fixtures/authored/claims/LD06-SL-C02--v1.0.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD06-SL-C02 v1.0); the first version of a new Claim of the LD-06 debate
  • CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD06-SL-C02 v1.0" (Project Lead (Claude, AI), 2026-10-15); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts
  • FIELD_6_SOURCE_REFERENCE = SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0 — basis: field 6 of ENTRY 02 — LD06-SL-C02 cites "Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
  • SOURCE_PROVENANCE_PIN = SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026".