spi: core: Don't destroy master queue if we fail to create it