Design an eval harness for incident post-mortems using promptfoo assertions that tracks user satisfaction (CSAT) across prompt versions on Gemini 2.0 Flash.
Design an eval harness for incident post-mortems using human pairwise comparison that tracks user satisfaction (CSAT) across prompt versions on DeepSeek-R1.
Design an eval harness for incident post-mortems using factuality with retrieval that tracks inter-judge agreement across prompt versions on Llama 3.1 405B.
Design an eval harness for incident post-mortems using embedding distance that tracks inter-judge agreement across prompt versions on Mistral Small 3.
Design an eval harness for incident post-mortems using rubric scoring that tracks cost-per-correct-answer across prompt versions on o1-mini.
Design an eval harness for incident post-mortems using factuality with retrieval that tracks cost-per-correct-answer across prompt versions on o3-mini.
Design an eval harness for incident post-mortems using embedding distance that tracks token cost across prompt versions on Command R+.
Design an eval harness for incident post-mortems using rubric scoring that tracks token cost across prompt versions on GPT-4.1.
Design an eval harness for incident post-mortems using LLM-as-judge that tracks token cost across prompt versions on Claude 3.5 Sonnet.
Design an eval harness for incident post-mortems using tool-call accuracy that tracks p95 latency across prompt versions on Claude 4 Sonnet.
Design an eval harness for incident post-mortems using G-Eval that tracks p95 latency across prompt versions on Claude Haiku 4.
Design an eval harness for incident post-mortems using exact match that tracks accuracy across prompt versions on Gemini 2.0 Flash.