I would suggest investigating how much effort it would take to alter your voice. Is it possible to do it live, or does it take post processing? There's no harm in doing it unless you meet up with internet people in the real world. Even then it may not really be an issue.

I've felt the same about parsing my comments via an AI because, using stylometry, a small sample of your comments are enough to de-anonymize all of your online accounts. It ultimately required too much effort and friction, plus I have decades of comments already out there so whatevs. I'm not here to fuck spiders.

I’m not (currently) in a position where others would find it desirable to do so. Potentially in the future?

It's hard to imagine a scenario where this would happen and your voice would not otherwise be available. For example, if you went into politics, then you'd be a target, but you'd already be speaking in public all the time. It only takes a few seconds of a voice sample to do this nowadays and it'll only get easier from here.

Maybe just make a point to educate your family and friends on the risk of voice cloning so they don't fall for phone scams.

Easy, become a vtuber with a voice altering software 😎

Very few YouTubers actually use their normal speaking voice. Keep an unusual formal cadence and be a little bit announcer-like.

You can find my voice at https://video.benetou.fr/ and elsewhere on the Internet because I did talks are conferences.

I'm not particularly worry by it ... because I expect people who are important to me (family, friends, even colleagues) to be trained enough (because it's not about intelligence) to contact me back (as they have my number, email, etc) if anything serious were to happen.

IMHO it's mostly a problem for basic phishing attack where somebody is rushed to provide information. As soon as the person replies "OK let me call you back" then the whole threat disappears. Well... if the hacker did manage to control your phone number or your email that's a totally different ballgame though but I assume we're not talking at this level.