Make sure party privacy is open and if yous have just added each other , restart the game and keep trying it should work eventually