I enjoyed playing tennis one summer when I was a little kid. I used a threadbare racket my mom had played with as a teen, and I competed in a free parks and rec program that did not (to put it mildly) inject talented children into the tennis elite pipeline.

But I kind of liked it, and I remember asking my mom once if I could try club tennis. She told me no, the equipment was too expensive and so were the membership fees. Out of our financial league. I could continue playing free Little League baseball in the park behind our house, using my cousin's hand-me-down mitt and bat.

So, I stopped playing tennis, not a tragedy to the tennis world, as I am the opposite of a natural athlete. ;-)

But this illustrates part of your point, I think. Sports like tennis and golf grew into existence as classist and thus effectively (and often deliberately) racist.

To see white people failing to keep a lock on elite play in those sports, despite structures that favor white people, really reinforces your main point.