I had thought that another part of it was the levels of harm compared to the problem; getting pregnant is incredibly stressful and possibly harmful, up to and including death as a possibility. A medicine that can stop that but has side affects that are less harmful than pregnancy is a lot more palatable. Whereas, for men, the harm caused by pregnancy is zero, so any harm caused by the pill is weighed a lot heavier.