Yes, and I feel like this is a little bit analogous to "sexual preference," which some people out of all good intentions use instead of "sexual orientation."

I don't get mad when somebody says "sexual preference," well, not unless I know they know better. But I often try to point out that I'm not gay by choice and that preference really is not the right word.

Likewise, I avoid the idea of preference when talking about someone's pronouns, which stand in for gender identity, which is not a choice, not even for trans people in the closet who whisper their pronouns only to themselves.