Not just all religions, but scouts, sports, teachers, whatever, wherever. Sometimes the implied authority is used against kids, but I'd like to think more often it's just that it provides cover to interact with kids.
Of course, if your position is supposed to mean a vow of no sex outside marriage or no sex or romance at all, then, well, you've got other issues. I was never too cool with having relationships with someone you are currently trying to teach other things to. It just seems like a conflict of interests that could get very complicated very quickly.
And yes, it is quite convenient to discredit an entire organization that might conflict with your other goals with a rare but highly socially disgraceful issue of a minority of members. OTOH, I've always thought it myself that people often go into the clergy because it just lends them cover for not wanting to enter a typical heterosexual marriage.
Eh, I'm not really in a thinking mood atm.