Preview: not announced. Search engines asked not to index.

Needham, Edkins, Pimpale, Bartsch & Hobbhahn, “Large Language Models Often Know When They Are Being Evaluated,” arXiv:2505.23836 (v3), July 2025

Source SRC-SL-NEEDHAM-ET-AL-EVALUATION-AWARENESS-ARXIV-2505-23836

Open the original (arXiv; link checked 2026-10-19)

Type of source
Preprint
Institutional position
Research programme and evaluation organization (MATS and Apollo Research)

Version

This is the current version, v1.0. Earlier versions stay available, and their records never change.

Versions: v1.0 · current

Claims that cite this source

Raw record: coded values of this source record
Source class (bibliographic)
PREPRINT
Source-level roles
none
Visibility
PUBLIC_REFERENCE
Registry section
none
Registry “Linked claim” (logical Claim identity; never a pinned version)
LD06-SL-C20
Cited in field 6 of
LD06-SL-C20--v1.0
Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 137ba86e9bc65457314d2894ca21948c633937e48a0e284000a8c250824e58a1.

Repository-authored inputs (not Drive exports)

  • SocioLens claim — LD06-SL-C20 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 20 — LD06-SL-C20” SHA-256 6285c7c78860f41ecea6ae4cd1e121be26877968d868c4cd241fee393020e425; fixture fixtures/authored/claims/LD06-SL-C20--v1.0.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
  • CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-NEEDHAM-ET-AL-EVALUATION-AWARENESS-ARXIV-2505-23836--v1.0 current.
  • VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD06-SL-C20--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Needham, Edkins, Pimpale, Bartsch & Hobbhahn, “Large Language Models Often Know When They Are Being Evaluated,” arXiv:2505.23836 (v3), July 2025".) (Amendment v1.2 §4, §6).