An ever easier solution is to call your credit card company and tell them you wish to have your credit card cancelled and a new one made because you suspect fraud. They are more than happy to do that. Now the ISP will be billing a cancelled credit card since your new one will have a new number on it too. Since I don't use automated billing for anything, I have no problem doing this since I don't need to contact and legitimate companies that I would want for automated billing.
An ever easier solution is to call your credit card company and tell them you wish to have your credit card cancelled and a new one made because you suspect fraud. They are more than happy to do that. Now the ISP will be billing a cancelled credit card since your new one will have a new number on it too. Since I don't use automated billing for anything, I have no problem doing this since I don't need to contact and legitimate companies that I would want for automated billing.