My dad raised me by himself as a single parent. He had to deal with a lot of flak and backlash from other parents for not raising me properly or from withholding me from my mother. He often had mothers tell him that he was actively harming me because kids cannot be raised by a dad. He had to stop attending some group-parenting functions because of the harassment.
My mother abandoned me when I was a toddler and my father saved my life. He uprooted and upturned his entire life just to provide care for a kid that was unceremoniously dumped on him. He's not perfect but who is?
This is certainly a multifaceted issue but the gender stereotype problem runs deep and it does a lot of damage. Instead of uplifting people and helping them, we tear them down and shame them.