NFSD: Clean up forgetting and recalling delegations