Design an eval harness for incident post-mortems using JSON schema validation that tracks accuracy across prompt versions on DeepSeek-R1.
Design an eval harness for incident post-mortems using Trulens feedback functions that tracks F1 score across prompt versions on Llama 3.1 405B.
Design an eval harness for incident post-mortems using BLEU/ROUGE that tracks F1 score across prompt versions on Mistral Small 3.
Design an eval harness for incident post-mortems using regex match checks that tracks factuality across prompt versions on o1.
Design an eval harness for incident post-mortems using DeepEval metrics that tracks factuality across prompt versions on o3-mini.
Design an eval harness for incident post-mortems using semantic similarity that tracks factuality across prompt versions on Command R+.
Design an eval harness for incident post-mortems using BERTScore that tracks refusal rate across prompt versions on GPT-4.1.
Design an eval harness for incident post-mortems using promptfoo assertions that tracks refusal rate across prompt versions on Claude 3.5 Sonnet.
Design an eval harness for incident post-mortems using human pairwise comparison that tracks toolcall precision across prompt versions on Claude 4 Sonnet.
Design an eval harness for incident post-mortems using factuality with retrieval that tracks toolcall precision across prompt versions on Claude Haiku 4.
Design an eval harness for incident post-mortems using embedding distance that tracks format-compliance rate across prompt versions on Gemini 2.0 Flash.
Design an eval harness for incident post-mortems using rubric scoring that tracks format-compliance rate across prompt versions on DeepSeek-R1.