Handle flags on challenge timers correctly to prevent confusing the event