Runs are only activated when they are 'complete' meaning, every query has a ranking. This should be clearly visible in the dashboard. Maybe with blinking warnings when rankings are incomplete, or even an email when they stay incomplete for too long a time. The warning should be sent on time before test period starts.
Sort of related to #98