Zheng, Chiang, Sheng et al., “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena,” NeurIPS 2023 Datasets and Benchmarks Track, arXiv:2306.05685
Source SRC-SL-ZHENG-ET-AL-MT-BENCH-NEURIPS-2023
Open the original (arXiv; link checked 2026-10-19)
- Type of source
- Peer-reviewed conference paper
- Institutional position
- Academic team that runs Chatbot Arena (LMSYS)
Version
This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.
This pinned version is also the current version.
Claims that cite this source
- The team behind Chatbot Arena found that GPT-4 as a judge agreed with human… Claim LD06-SL-C19 (v1.0)
Raw record: coded values of this source record
- Source class (bibliographic)
- PEER_REVIEWED_CONFERENCE_PAPER
- Source-level roles
- none
- Visibility
- PUBLIC_REFERENCE
- Registry section
- none
- Registry “Linked claim” (logical Claim identity; never a pinned version)
- LD06-SL-C19
- Cited in field 6 of
- LD06-SL-C19--v1.0
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 f14037a239a0a41280055b05d7502226702223783b6584399414e7cc9da9d381.
Repository-authored inputs (not Drive exports)
- SocioLens claim — LD06-SL-C19 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 19 — LD06-SL-C19” SHA-256
e7be603bf130cb2a7a73a5e986f367c218399035a988d6a0b15e86bb3425fde9; fixturefixtures/authored/claims/LD06-SL-C19--v1.0.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
- CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-ZHENG-ET-AL-MT-BENCH-NEURIPS-2023--v1.0 current.
- VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD06-SL-C19--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Zheng, Chiang, Sheng et al., “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena,” NeurIPS 2023 Datasets and Benchmarks Track, arXiv:2306.05685".) (Amendment v1.2 §4, §6).