Design an eval harness for log anomaly detection using embedding distance that tracks user satisfaction (CSAT) across prompt versions on Mistral Large.
Design an eval harness for log anomaly detection using human pairwise comparison that tracks user satisfaction (CSAT) across prompt versions on Qwen 2.5 72B.
Design an eval harness for log anomaly detection using factuality with retrieval that tracks inter-judge agreement across prompt versions on o1-mini.
Design an eval harness for log anomaly detection using embedding distance that tracks inter-judge agreement across prompt versions on o3-mini.
Design an eval harness for log anomaly detection using rubric scoring that tracks cost-per-correct-answer across prompt versions on Command R+.
Design an eval harness for log anomaly detection using LLM-as-judge that tracks cost-per-correct-answer across prompt versions on GPT-4o-mini.
Design an eval harness for log anomaly detection using tool-call accuracy that tracks token cost across prompt versions on Claude 3.7 Sonnet.
Design an eval harness for log anomaly detection using G-Eval that tracks token cost across prompt versions on Claude 4.5 Sonnet.
Design an eval harness for log anomaly detection using exact match that tracks token cost across prompt versions on Claude Haiku 4.
Design an eval harness for log anomaly detection using JSON schema validation that tracks p95 latency across prompt versions on Gemini 2.0 Flash.
Design an eval harness for log anomaly detection using Trulens feedback functions that tracks p95 latency across prompt versions on DeepSeek-R1.
Design an eval harness for log anomaly detection using BLEU/ROUGE that tracks accuracy across prompt versions on Mistral Large.