USB: remove references to port->port.count from the serial drivers