There isn't and Lemmygrad.ml users have been doing it in the past. Mostly down-vote brigading though and this is the main reason why down-votes are disabled on our instance.
Personally I think there should be a setting to prevent down-votes from federating as there is really no point in federating them to instances with other rules and different community culture.