I think it’s self-evidently true that human beings are more sexually diverse then many of us acknowledge. Just looking at other ways of being sexually, either in the past or in cultures that are different from our own, it’s obvious that strictly polarized sexual orientations are not the human norm.
But that doesn’t mean that polarization doesn’t happen, either. I only mention that because as a gay man, I have never managed to feel any significant sexual attraction toward women. I mean, clearly, I’ve been socialized to feel that, but I still can’t.
So, while I agree with your premise that most humans probably share more universal sexual attraction then our particular culture likes to admit, I have to add that that doesn’t apply to everyone.