Well, now I did .. after Proxmox install, we're heading the right direction: 1 CPU installed, 2x32GB RAM (as above) plus Raid controller P408i, 8x SAS backplane and 2x 10Gb Eth. NIC it idles at 74W out of which 15W go to the CPU. With 2 CPUs we get 87W in total with 19W on the CPU.
That's a completely different story. Was not aware of this ..
I set it to optimised for virtualization originally .. have to play around with this some more. Let's see.