As others have said, springtails.
They usually only eat dead stuff, but still can harm the plant sometimes. But mostly, they're disgusting imo.
Best ways to get rid of them:
- Don't overwater your soil. Keep it on the dryer side and add some drainage (stones on the bottom, some perlite, etc.) to keep everything aerated
- Or, try switching to inorganic substrate, e.g. pon or LECA. That way, you can get rid of pretty much any soil living pest. But by transplanting the plant you can also kill it, especially since it's already stressed.