There are several conditions for a man to be held accountable.
If the woman consulted the man, and yet the situation still escalated, then that man might be a different creature altogether, merely resembling a human.
Furthermore, if the woman reached that decision without consulting him, then the man's guilt would be as light as a feather floating in the sky.