Yeah that's mostly true... But it's not like a hangover... I had a friend bitten by a snake out in the Mojave once and I'm sure she would have strong opinions about how strenuous the recovery was from it. Neurotoxins, especially potent ones, can be disruptive enough to create long term disabilities. If you are someone who performs a lot of skilled fine motor movements as part of your job or as part of a hobby or something it could be a significant amount of time for you to fully recover from a neurotoxin.

Cytotoxins are interesting as well, though generally not considered deadly they can really mess up your quality of life and be extremely debilitating, even disfiguring.

Generally just a good idea to stay away from anything venomous.