KVM: arm/arm64: Handle forward time correction gracefully