Specialist-model research desk

Comparisons

What comparison could change the decision?

Frontier Development research deskSection 03 · Page 7 of 11Last updated 26 October 2026

Run an explicit sensitivity review: reduce volume; reduce API prices hypothetically; increase human-review minutes; add required redundancy; and remove a planned discount. If the winner changes easily, buy a smaller experiment or shorter commitment. A robust no-build decision is often more valuable than an optimistic ranking.

The final comparison should contain measured results, assumptions, missing evidence and a next test for every viable option. This keeps supplier choice tied to the buyer’s problem instead of a fashionable training method.

TRACE THE EVIDENCE

Section source library

This page contains no direct external citations. These are the section’s references; they do not independently validate the desk’s proposed scoring or methods.

  1. A Small Model Asks Better: Fine-Tuning Query Clarification for Retrieval-Augmented Generation — He, Popa and Danilevsky, 19 October 2026 →arxiv.org
  2. Together AI — AI Native Cloud →www.together.ai
  3. Llama 3.3 Community License Agreement — Meta →github.com
  4. Pricing — Together AI, snapshot checked 26 October 2026 →www.together.ai
  5. Demystifying evals for AI agents — Anthropic, 9 January 2026 →www.anthropic.com
  6. SFT Trainer — Hugging Face TRL documentation →huggingface.co
  7. RouteLLM: Learning to Route LLMs with Preference Data — Ong et al., revision 23 February 2025 →arxiv.org
  8. Extend — Extraction Overview →docs.extend.ai
  9. QLoRA: Efficient Finetuning of Quantized LLMs — Dettmers et al., 23 May 2023 →arxiv.org
  10. LoRA Learns Less and Forgets Less — Biderman et al., revision 20 September 2024 →arxiv.org
  11. Quantization — Hugging Face PEFT documentation →huggingface.co
  12. Fireworks — specialised intelligence platform →fireworks.ai
  13. Winder.AI — Generative AI Consulting & Development Services →winder.ai
  14. Modal — platform for production AI →modal.com
  15. Baseten — inference platform →www.baseten.co