Yes orders of magnitude, but not too many of them. The real estate of a 300 mm wafer is limited, the structure shrink is saturating and you can't get too many layers. You still need a packet switched network on the wafer even if the rest is mostly analog. Perhaps spintronics can limit the power requirements too.
I think we are already at the catabolic collapse stage where the elites are cannibalizing the periphery before the heartland. On the other hand the US has been also being stripped bare in patches for a while. So it is a simultaneous progressive process.
And these power lines into the EU are very easy to disrupt and disrupt again after repairs.
Factor in power bills and heat and noise into your calculations.
Secure has no meaning.
Sadly, you can't download the hardware to run models that size.
There are diminishing returns in semiconductor photolitho. Moore scaling is long over, absolute real estate see WSI with Cerebras, DC costs and power envelope are all sending a clear message. Quantization is there, so you can go from digital multipliers to analog and go spiking networks, but transformers and Co have little power there.
Also, the kind of economy that can carry Gen AI as business model is not a given, long term.
You could highlight the phrase, and he'll still fail to get it.
There is a reason 1984 was written by a Brit.
Nicely put. I fully agree with this description.