blackfin: pinctrl-adi2: code cleanup after using pinctrl-adi2