usb_serial: Fix remaining ref count/lock bugs