Specialist-model research desk

Do-it-yourself game plans

Who needs to participate, and what should they deliver?

Frontier Development research deskSection 02 · Page 2 of 15Last updated 26 October 2026
Workstream Accountable role Contact or input required Deliverable
Business task Product owner Operations/customer-support owner Metric dictionary and failure-cost register
Evaluation AI/ML lead Domain reviewer independent of training Split manifest, rubric and locked test procedure
Data Data owner Customer-contract owner and security Inventory, provenance and permitted-use decision
Adaptation ML engineer Platform maintainer or managed service Versioned run configuration and artefacts
Serving Platform lead Cloud/inference provider Load test, rollback and monitoring plan
Commercial/legal Finance and counsel Procurement and contracting entity Cost model, rights schedule and acceptance terms

One person may cover several roles in a small team, but no responsibility should disappear. Keep the final acceptance decision on the buyer’s side.

TRACE THE EVIDENCE

Section source library

This page contains no direct external citations. These are the section’s references; they do not independently validate the desk’s proposed scoring or methods.

  1. Demystifying evals for AI agents — Anthropic, 9 January 2026 →www.anthropic.com
  2. Quantization — Hugging Face PEFT documentation →huggingface.co
  3. LoRA Learns Less and Forgets Less — Biderman et al., revision 20 September 2024 →arxiv.org
  4. Pricing — Together AI, snapshot checked 26 October 2026 →www.together.ai
  5. GroupKFold — scikit-learn documentation →scikit-learn.org
  6. A Field Guide to Rapidly Improving AI Products — Hamel Husain →hamel.dev
  7. Guidance on HIPAA & Cloud Computing — HHS Office for Civil Rights →www.hhs.gov
  8. TimeSeriesSplit — scikit-learn documentation →scikit-learn.org
  9. Extend — Extraction Overview →docs.extend.ai
  10. SFT Trainer — Hugging Face TRL documentation →huggingface.co
  11. RouteLLM: Learning to Route LLMs with Preference Data — Ong et al., revision 23 February 2025 →arxiv.org