This is, of course, the actual argument that religious institutions like the Roman Catholic Church and Evangelical Protestant institutions present in favor of being allowed to legally discriminate against and exclude gay people.
Being gay is not innate, they say, and the identity is not valid, because people who call themselves gay could choose not to have sex or could choose to marry and have sex with a partner of the opposite sex even if they don't find them attractive.
The argument is not convincing to gay people, because we claim the innate human right to pursue happiness and fulfillment in our relationships, free from authoritarian control and unjust discrimination.
Authoritarianism and unjust discrimination seem to be at the heart of gender-critical efforts to control transgender people.