96
Elon Musk's xAI plans to build 'Gigafactory of Compute' by fall 2025 — using 100,000 Nvidia's H100 GPUs
(www.tomshardware.com)
This is a most excellent place for technology news and articles.
That's probably the reason he is using an older version, the H200 is about to be released, and will free up supply of the older chips.