[SROA] Simplify some of the logic to dig out the old pointer value by