EVs are inherently simpler than ICE vehicles. Of course it will eventually take fewer man hours to build one, and that's where some of the eventual cost savings will come in from.
You can't complain about the high cost of cars today and then turn around and want artificially inflated labor hours for EVs. You can't have it both ways.