Specialist-model research desk

Readiness quiz

Editorial self-assessment

Frontier Development research deskSection 08 · Page 19 of 20Last updated 26 October 2026
Measure Score / 10
buyer_fit 9
depth 8
search_terms 9
sources 8

Practical, transparent instrument with auditable scoring and non-compensable blockers. Its validity is procedural rather than predictive, and that limitation is explicit.

TRACE THE EVIDENCE

Section source library

This page contains no direct external citations. These are the section’s references; they do not independently validate the desk’s proposed scoring or methods.

  1. Demystifying evals for AI agents — Anthropic, 9 January 2026 →www.anthropic.com
  2. Llama 3.3 Community License Agreement — Meta →github.com
  3. AI Risk Management Framework — NIST →www.nist.gov
  4. RouteLLM: Learning to Route LLMs with Preference Data — Ong et al., revision 23 February 2025 →arxiv.org
  5. A Field Guide to Rapidly Improving AI Products — Hamel Husain →hamel.dev
  6. GroupKFold — scikit-learn documentation →scikit-learn.org
  7. Pricing — Together AI, snapshot checked 26 October 2026 →www.together.ai
  8. The Inference Engineering Masterclass — Philip Kiely and Ali Taha, Latent Space, 3 August 2026 →latent.space
  9. The Open Source AI Definition 1.0 — Open Source Initiative →opensource.org
  10. SB26-189 Automated Decision-Making Technology — Colorado General Assembly →leg.colorado.gov
  11. Guidance on HIPAA & Cloud Computing — HHS Office for Civil Rights →www.hhs.gov