Add support for a marker byte that indicates that we shouldn't add the user