Oh, it’s OK. I understand most people use it quite neutrally. In some cultures (like Italian and Spanish) it’s the preferred polite word. I even use it once in a while if I’m speaking in a purely clinical sense, though in cases like that, I’m still more likely to use “same sex attracted.”
The thing I’m very careful about is not identifying as homosexual. I reject that label for myself because of its history.
But I don’t get upset if other people use it.