perf build: Remove PERF-CFLAGS file