Run a rigorous A/B test on prompt variants for financial report analysis, measuring F1 score on Qwen 2.5 72B using embedding distance.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring cost-per-correct-answer on o1-mini using tool-call accuracy.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring factuality on GPT-4o using JSON schema validation.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring token cost on GPT-4o-mini using regex match checks.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring hallucination rate on Claude 3.7 Sonnet using regex match checks.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring p95 latency on Claude Haiku 4 using factuality with retrieval.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring user satisfaction (CSAT) on Gemini 2.0 Flash using factuality with retrieval.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring refusal rate on Llama 3.3 70B using LLM-as-judge.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring p95 latency on Mistral Large using LLM-as-judge.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring toolcall precision on o1-mini using exact match.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring accuracy on o3-mini using BLEU/ROUGE.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring inter-judge agreement on Command R+ using semantic similarity.