I like men!
However, I don't like misogyny. I don't like sexism.
I think the majority of men are not misogynistic. Men are not equal to misogyny, they are very different things. Any man that equates himself to misogyny, may be misogynistic. So if by saying I hate misogyny, makes men assume I hate men, then they might misogynists.
Most men are good people! I don't know many misogynists personally, I may have run into a few every now and then. If a man assumes I hate him because I hate misogyny, then he is aligning himself with misogyny, and is identifying as a misogynist.
I hate sexism and misogyny. But I like men.
I have met men I don't like, but I've also met a lot of women I don't like too. I tend to avoid misogynists, both male and female in general.