spi: dw: move piece of code out of condition