Does the EU's training-compute criterion track how general a model is?

Research question

Across open-weight and documented models released from 2020 to 2026, how closely does training compute predict measured generality (the range of distinct tasks performed competently), and how many models fall on the wrong side of the 10²³ FLOP indicative criterion that the European Commission uses for a general-purpose AI model?

Why it matters

The EU has turned "what kind of thing is it?" into law: a model is general-purpose if it displays significant generality, and the Commission's guidelines adopt an indicative criterion under which a model above 10²³ FLOP with generative ability likely is general-purpose, while calling compute an imperfect proxy. If the proxy misclassifies many models, the legal ontology diverges from the technical one, and obligations fall on the wrong models. No published study measuring this was found.

The debate lists this among what we still do not know: Does training compute track the generality that the EU's criterion is meant to capture?

Evidence that motivates it

1. The European Commission’s guidelines note that the AI Act’s definition of a “general-purpose AI model” “does not set out specific criteria” and adopt an indicative criterion: training compute above 10²³ FLOP and the ability to generate language, images or video, while calling compute “an imperfect proxy for generality and capabilities.” (LD01-SL-C36 v1.0)
   The Commission adopts 10²³ FLOP plus generative ability as an indicative criterion and calls compute an imperfect proxy.
   Cites: European Commission (2025), “Guidelines on the scope of…”
2. Bommasani and colleagues named “foundation models” for their “critically central yet incomplete character,” argued that their significance lies in “emergence and homogenization,” warned that homogenization “creates single points of failure,” and predicted that the barrier to entry for developing them “will continue to rise.” (LD01-SL-C28 v1.0)
   The foundation-model idea of a general base adapted downstream, which the legal category resembles.
   Cites: Bommasani et al. (2021), “On the Opportunities and Risks…”

Claims are shown as they read on the day this pack was built; claim pages keep every earlier version.

A possible design

Assemble a dataset of models with documented or estimated training compute and run a fixed battery of distinct task families to measure generality, defining competence thresholds in advance. Estimate the relation between compute and generality, the rates of models above the threshold that lack generality and below it that have it, and how these rates change with time as training becomes more efficient. Compare alternative proxies such as benchmark breadth.

Data needed

Model inventories with training-compute estimates; open weights or API access; a task battery covering distinct task families.

Feasibility

One PhD chapter or paper. Medium; compute for evaluating open models and API fees for closed ones. Training compute is often estimated rather than disclosed; carry the uncertainty through. "Significant generality" has no legal operationalization, so the study should report results under several definitions.

Has this been done?

The search found no study that does the core design (first-pass screen of 16 October 2026; not yet checked in depth).

No published study was found that measures how well training compute predicts generality around the EU threshold. Search results were legal commentary describing the criterion as a presumption.

Where the search could not reach. Screened by one web search and the LD-01 source scan on the date shown; policy-research papers on compute thresholds were not read. Absence of a hit is not proof that the work does not exist.

Before building a project on it, run your own search in a scholarly database such as Scopus, Web of Science, Google Scholar or SSRN.

Nearest work found

• European Commission, guidelines on general-purpose AI models (LD01-SL-C36)
  Full text read for this debate. Sets the criterion and its rationale; reports no measurement.

References

Sources behind the motivating claims:

• European Commission, “Guidelines on the scope of the obligations for providers of general-purpose AI models established by Regulation (EU) 2024/1689 (AI Act),” C(2025) 7719 final, 19 November 2025 (SRC-SL-EC-GPAI-GUIDELINES-C-2025-7719, no checked link to the original yet)
• Bommasani et al., “On the Opportunities and Risks of Foundation Models,” arXiv:2108.07258, 2021 (SRC-SL-BOMMASANI-ET-AL-ARXIV-2108-07258, original)

BibTeX

The first entry cites this opportunity; then its nearest work; then the sources above. Nearest work and sources are recorded as reference strings, so each goes in whole as the title; add authors and year from the original before you cite it.

@misc{sociolens_ro_ld01_05_v1,
  author = {{SocioLens project}},
  title = {Does the EU's training-compute criterion track how general a model is?},
  year = {2026},
  date = {2026-10-16},
  howpublished = {\url{https://sociolens-web.pages.dev/opportunities/ro-ld01-05/v1/}},
  note = {Research opportunity RO-LD01-05, version v1}
}

@misc{ro_ld01_05_nearest_1,
  title = {European Commission, guidelines on general-purpose AI models (LD01-SL-C36)},
  url = {https://digital-strategy.ec.europa.eu/en/library/guidelines-scope-obligations-providers-general-purpose-ai-models-under-ai-act},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_sl_ec_gpai_guidelines_c_2025_7719,
  title = {European Commission, “Guidelines on the scope of the obligations for providers of general-purpose AI models established by Regulation (EU) 2024/1689 (AI Act),” C(2025) 7719 final, 19 November 2025},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_sl_bommasani_et_al_arxiv_2108_07258,
  title = {Bommasani et al., “On the Opportunities and Risks of Foundation Models,” arXiv:2108.07258, 2021},
  url = {https://arxiv.org/abs/2108.07258},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}