Because a lot of them are. Obviously most of it is generalizing, but when your political movement is known for being anti-gay and anti-abortion, naturally most people are going to assume it's made up of closed-minded bigots. Obviously there's more to being conservative than those two issues, but even a lot of conservatives have made it solely about those two issues.