Specialist-model research desk

Readiness quiz

What should the result page or internal note contain?

Frontier Development research deskSection 08 · Page 16 of 20Last updated 26 October 2026

Write the total, gate status, three highest-priority gaps, owner and next evidence required. Keep an explicit “retain current API” outcome. The desk recommends a metadata-only first review: dataset descriptions, cost units and example failure categories normally suffice to identify preparation work without receiving customer records.

TRACE THE EVIDENCE

Section source library

This page contains no direct external citations. These are the section’s references; they do not independently validate the desk’s proposed scoring or methods.

  1. Demystifying evals for AI agents — Anthropic, 9 January 2026 →www.anthropic.com
  2. Llama 3.3 Community License Agreement — Meta →github.com
  3. AI Risk Management Framework — NIST →www.nist.gov
  4. RouteLLM: Learning to Route LLMs with Preference Data — Ong et al., revision 23 February 2025 →arxiv.org
  5. A Field Guide to Rapidly Improving AI Products — Hamel Husain →hamel.dev
  6. GroupKFold — scikit-learn documentation →scikit-learn.org
  7. Pricing — Together AI, snapshot checked 26 October 2026 →www.together.ai
  8. The Inference Engineering Masterclass — Philip Kiely and Ali Taha, Latent Space, 3 August 2026 →latent.space
  9. The Open Source AI Definition 1.0 — Open Source Initiative →opensource.org
  10. SB26-189 Automated Decision-Making Technology — Colorado General Assembly →leg.colorado.gov
  11. Guidance on HIPAA & Cloud Computing — HHS Office for Civil Rights →www.hhs.gov