You can disable mod downloading (cl_allowDownload) to avoid playing on servers that have mods that require download. Pluto BO2 has options in the server browser to filter out trickshot/sniper (MP) and bank (ZM) servers.
Aside from that, you can search for servers with "vanilla" in their name to hopefully not get servers that have mods that aren’t filtered by those options.