fanotify: only destroy mark when both mask and ignored_mask are cleared