PM / domains: avoid potential oops in pm_genpd_remove_device()