We are talking about religion. If my religion tells me that it is a sin to be around nonbelievers or sinners or whatever and I am really serious about my religion, there is no choice.
At some point, doesn't your responsibility to be a responsible civil servant (in this case, building good community relations) supersede whatever personal religious beliefs you have?
I'm really asking. I don't know the answer to this.