perf annotate: Fix up usage of the build id cache