hrtimers: Avoid touching inactive timer bases