Shrink a SmallVector with a known maximum size.