Run a rigorous A/B test on prompt variants for financial report analysis, measuring p95 latency on Claude 3.7 Sonnet using embedding distance.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring user satisfaction (CSAT) on Claude 4.5 Sonnet using embedding distance.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring refusal rate on Claude Haiku 4 using tool-call accuracy.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring accuracy on DeepSeek-V3 using JSON schema validation.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring inter-judge agreement on Llama 3.3 70B using JSON schema validation.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring toolcall precision on Mistral Large using regex match checks.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring accuracy on Qwen 2.5 72B using regex match checks.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring format-compliance rate on o3-mini using factuality with retrieval.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring F1 score on GPT-4o using factuality with retrieval.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring cost-per-correct-answer on GPT-4o-mini using LLM-as-judge.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring factuality on Claude 4.5 Sonnet using exact match.
Run a rigorous A/B test on prompt variants for financial report analysis, measuring token cost on Claude Haiku 4 using exact match.