Specialist-model research desk

Readiness quiz

What does the total mean?

Frontier Development research deskSection 08 · Page 15 of 20Last updated 26 October 2026

Apply the hard gates first, then use the score as a preparation guide.

Points / 24 Preparation band Recommended next step
0–7 Foundations missing Define task, ownership and data inventory before asking for training quotes
8–15 Preparation required Fix the weakest evidence areas; commission a bounded readiness review if useful
16–20 Near a scoped pilot Close gate conditions and finalise baseline, acceptance and cost assumptions
21–24 Ready to specify a controlled pilot Seek comparable scoped proposals; readiness is not proof of an adaptation win

Worked example — hypothetical: a team scores 20/24 but answers A on rights. Its result is “Blocked for commissioning”, not “near ready”. A second team scores 18/24 with all four gates at C; it can prepare a narrow pilot while closing non-gate gaps before their relevant stage.

Do not convert 18/24 into a “75% chance of success”. No such predictive validation exists for this quiz. Re-score only when evidence changes, retaining the earlier version so improvement is inspectable.

TRACE THE EVIDENCE

Section source library

This page contains no direct external citations. These are the section’s references; they do not independently validate the desk’s proposed scoring or methods.

  1. Demystifying evals for AI agents — Anthropic, 9 January 2026 →www.anthropic.com
  2. Llama 3.3 Community License Agreement — Meta →github.com
  3. AI Risk Management Framework — NIST →www.nist.gov
  4. RouteLLM: Learning to Route LLMs with Preference Data — Ong et al., revision 23 February 2025 →arxiv.org
  5. A Field Guide to Rapidly Improving AI Products — Hamel Husain →hamel.dev
  6. GroupKFold — scikit-learn documentation →scikit-learn.org
  7. Pricing — Together AI, snapshot checked 26 October 2026 →www.together.ai
  8. The Inference Engineering Masterclass — Philip Kiely and Ali Taha, Latent Space, 3 August 2026 →latent.space
  9. The Open Source AI Definition 1.0 — Open Source Initiative →opensource.org
  10. SB26-189 Automated Decision-Making Technology — Colorado General Assembly →leg.colorado.gov
  11. Guidance on HIPAA & Cloud Computing — HHS Office for Civil Rights →www.hhs.gov