omap4: Fix bootup crash observed with higher CPU clocks