It is possible to over-optimize to a metric. The counterweight measurement strategy is your safeguard to keep you from optimizing to short term gains at the expense of long term loss.
This strategy is designed to give you a gut check on your results to ensure that you are aren’t robbing your future success and helps you appropriately balance your metrics and results.
In this video, you will learn several things to improve your testing efforts including:
- What the counterweight measure strategy is
- How to decide your counterweight metrics
- Examples of what it looks like in practice
Testing Theory is where professional testers turn to do better A/B testing and get more conversions.