Actually, in my country, all clubs are tax exempt (or have the right to be), as are other non-profit organizations. Only profit-making businesses pay income taxes and most other taxes. I don't have a problem with that, so I don't have a problem with churches being tax exempt. Because the status isn't special to churches, with the caveat that some of their paperwork and reporting requirements are different — which I don't think is constitutionally proper, but is not much of a hill to die on.

I certainly have a problem with churches spending taxpayer money to discriminate against members of minorities.