It's because: friendly inquiries are sometimes followed up with angry or threatening ones if the woman doesn’t properly respond.
This often make the women trapped in the situation where they're feeling too awkward to politely ignore them and too afraid to casually pass without making any reaction.