They won't leave us in peace unless we leave offerings. Lucky for us, we've got Food Offering missions to earn extra consumables for those departed and our crew too.
If you're up for ghost-busting, complete Battle Mission: Begone, Evil Spirit! to receive a "Hungry Ghost" style!