Resource · Last updated July 14, 2026 · By the ColdDMCalculator team
Cold DM A/B Test Scorecard: Track and Compare Results
A/B testing is how you turn cold DM outreach from guesswork into a systematic process. This scorecard gives you a structured way to record test parameters, track results, and determine when you have a clear winner.
Test record template
Fill in this template before you start each test. Define the variable, the variants, and the target sample size.
Test name
Variable tested
Variant A description
Variant B description
Start date
Target sends per variant
Actual sends — A
Actual sends — B
Results tracker
Record results as they come in. Don't wait until the test is over — update daily so you can spot trends early.
| Metric | Value | Notes |
|---|---|---|
| Replies — A | ___ | Total replies for variant A |
| Replies — B | ___ | Total replies for variant B |
| Reply rate — A | ___% | Replies ÷ sends for A |
| Reply rate — B | ___% | Replies ÷ sends for B |
| Positive replies — A | ___ | Interested replies for A |
| Positive replies — B | ___ | Interested replies for B |
| Positive reply rate — A | ___% | Positive ÷ total replies for A |
| Positive reply rate — B | ___% | Positive ÷ total replies for B |
| Meetings booked — A | ___ | Meetings from A |
| Meetings booked — B | ___ | Meetings from B |
Statistical significance guide
Use this guide to determine when you have enough data to call a winner. Bigger sample sizes let you detect smaller differences.
| Sample size | Min. difference to detect | Confidence level |
|---|---|---|
| 50 per variant | 20%+ difference | Directional |
| 100 per variant | 15%+ difference | Moderate |
| 200 per variant | 10%+ difference | Strong |
| 500+ per variant | 5%+ difference | High |
How to Use This Resource
- Complete the test record template before starting each test — define the variable and target sample size.
- Update the results tracker daily. Don't wait until the test is over.
- Use the significance guide to decide when you have enough data to call a winner.
- Run the Cold DM Calculator with the winning variant's rates to project campaign-scale impact.
This resource is for educational planning purposes. Results vary based on execution, audience, and platform rules.
Related: All Resources · A/B Testing Guide · Script Scorecard · Script Worksheet
Frequently asked questions
How many variants should I test at once?
Two. Testing three or more variants splits your sample too thin. If you want to test multiple variables, run sequential tests — test the opener first, then test the CTA with the winning opener.
What's the minimum sample size for a reliable test?
50 sends per variant is the minimum for directional results. 100 per variant gives you moderate confidence. Below 50, the results are too noisy to trust — you're guessing, not testing.
How do I know if the difference is statistically significant?
Use the significance guide above as a rule of thumb. For formal statistical testing, use a chi-squared test or an online A/B test calculator. A p-value below 0.05 means the difference is likely real, not random.
What if the results are close?
If the difference is under 10% with fewer than 200 sends per variant, send more. If it's still close after 200+ sends per variant, either variable may not matter much — move on to testing a different variable.
Test smarter, not harder.
Use the calculator to see what a 1% reply rate improvement is worth at scale.
Forecasts are estimates based on user-provided assumptions. Results are not guaranteed.