Counterpoint: an electric vehicle does most of its braking by regenerating power into the battery. Brake pads are replaced super rarely.
Going by mass and comparing with fuel use on an IC vehicle - a set of tyres every 4 years weighs about 40 kilograms. What amount of rubber is destroyed? Maybe 10%, so maybe 4 kg of tyre-based pollutants escape into the environment as fine dust.
To compare, the amount of fuel is huge - at 5 l / 100 km, driving 1000 km/month: 600 liters per year, 2400 liters per 4 years. Clearly fuel is the dominant pollutant by mass. Tyre materials would have to be 600 times more toxic to be an equal health risk.