Move some logic to populateLTOPassManager.