Just because you don't think so doesn't mean those things haven't had influence on the cultural perception of it.
I understand the desire to separate yourself from those things as an individual. And I don't know what method will work, but simply telling people the "manosphere" just doesn't count isn't going to change anyone's minds.
That may be the case but it is not a rebuttal to my point.
Those things have had an influence on the perception of masculinity. And yes, TERFs have had an influence on the perception of feminism. And simply saying they don't count isn't an effective way of countering that influence.