You can use the adjective misogynic when you're talking about a man who dislikes or distrusts all women.
A state governor who is doubtful about appointing any women to his Cabinet can be described as misogynic, or deeply distrustful of women. This word's meaning is very close to the meaning of misogynistic, or "hating women," but it's tempered a bit. A misogynic person is dubious of women, but he may not feel a full-out hatred toward them. The word, however, is rooted in the Greek miso, or "hatred," and gyne, or "woman."