I just finished reading the book unChristianby Dave Kinnaman and Gabe Lyons. It's the result of a research project led by the Barna Group to determine what people in our generation really think about Christians. Christians are not called to be popular. In fact, Jesus promised us we would not be popular. So bad feelings towards our kind doesn't necessarily indicate a problem. But when people have a negative image of Jesus for the wrong reasons- because we have been hypocritical, judgmental, confused our mission, or demonstrated any number of the other unBiblical and Pharisaical attitudes and actions that we've adopted over the years- then that is bad.
It's a wake up call. And it's something I think every pastor should read. You may not agree with everything in the book, and you certainly will find yourself feeling defensive at different points. But it's important to listen to these voices. Jesus listened. And then he responded in a loving but challenging way that was unique to each individual. I dream of being able to minister like that!
If you're interested in this topic, I'd also recommend They Like Jesus but Not the Church by Dan Kimball.