net phylib: Remove unnecessary condition check in phy