Plutonium

I FOUND a semi-consistent FIX. When you invite your friend to your game don't leave the friend invite screen until they join the party. An example like, start your own custom zombies game -> pick a map -> press F to select your friend -> press invite and don't leave that window until they join. I found that to work more often than not.