The reactionary response to transgender people is all about panic and fear, in my opinion. Social conservatives feel invested in their moral worldviews, to the point that people behaving differently from the way they want feels personally threatening to them.
Then Matt Walsh and similar figures play on those fears for profit or power:
See? Those scary trans people are powerful because you can’t make them go away.
Cue end-of-Western-Civilization rant.
The reality, of course, is that the people exercising actual power are the people succeeding in taking freedom from trans people, who are entitled to their own choices in life notwithstanding the fears of social conservatives and reactionaries.