Don't use a densemap for keeping track of which vregs are already loaded, just