DenseMap: Use an early exit when there is nothing to do in DestroyAll().