[XFS] Clean up use of VFS attr flags