Oh I agree.
But if a guy says "It's ok, I'm on the pill" would you really wanna trust him? I sure as hell wouldn't.
Society has to get better at teaching guys not to sexually assault people. If you lie about being on birth control and subsequently impregnate someone, I'm pretty sure that checks the sexual assault boxes.
It also doesn't have to be an exclusionary choice. Condoms AND a pill for men AND a pill for women is a great way for everyone to stay safe, have fun, avoid diseases, and not make surprise babies. "And" is ok, maybe even great. "Or" leaves a lot of room for human error, malice, and in-the-moment selfishness to cause long lasting life changes.